Sep 17 07:16:34 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 07:16:34 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 07:16:34 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 07:16:36 devstack cinder-volume[75845]: INFO dbcounter [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Registered counter for database cinder
Sep 17 07:16:36 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:16:36 devstack cinder-volume[75845]: DEBUG dbcounter [-] [75845] Writer thread running {{(pid=75845) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 07:16:36 devstack cinder-volume[75845]: INFO cinder.rpc [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 17 07:16:36 devstack cinder-volume[75845]: INFO cinder.rpc [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 17 07:16:36 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:16:36 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Determined volume DB was empty at startup.
Sep 17 07:16:36 devstack cinder-volume[75845]: DEBUG cinder.volume.manager [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75845) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 17 07:16:36 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 17 07:16:36 devstack cinder-volume[75845]: WARNING stevedore.named [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 07:16:36 devstack cinder-volume[75845]: WARNING castellan.key_manager [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 07:16:36 devstack cinder-volume[75845]: WARNING cinder.keymgr.conf_key_mgr [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 07:16:36 devstack cinder-volume[75845]: DEBUG cinder.volume.drivers.lvm [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75845) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 17 07:16:37 devstack cinder-volume[75845]: DEBUG oslo_concurrency.processutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75845) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_concurrency.processutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] CMD "cinder-rtstool verify" returned: 0 in 1.098s {{(pid=75845) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:16:38 devstack cinder-volume[75845]: INFO cinder.rpc [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 17 07:16:38 devstack cinder-volume[75845]: INFO cinder.rpc [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 17 07:16:38 devstack cinder-volume[75845]: WARNING stevedore.named [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 07:16:38 devstack cinder-volume[75845]: WARNING castellan.key_manager [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 07:16:38 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:16:38 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Starting 1 workers
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Started child 75976 {{(pid=75845) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 17 07:16:38 devstack cinder-volume[75976]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.1)
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Full set of CONF: {{(pid=75845) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] ******************************************************************************** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Configuration options gathered from: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] ================================================================================ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] allow_availability_zone_fallback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] allow_compression_on_image_upload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] allowed_direct_url_schemes     = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] api_rate_limit                 = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] auth_strategy                  = keystone {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] az_cache_duration              = 3600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_availability_zone      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:38 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_host                   = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_name                   = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_stats_polling_interval = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backup_api_class               = cinder.backup.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backup_name_template           = backup-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backup_use_same_host           = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backup_use_temp_snapshot       = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] chap_password                  = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] chap_username                  =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_internal_tenant_project_id = 70a0042174ef4d9fb18f2ec25b739678 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_internal_tenant_user_id = a21c086b33554dabb4494d7d5819206a {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cloned_volume_same_az          = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cluster                        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] compression_format             = gzip {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] config_dir                     = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] config_source                  = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] control_exchange               = openstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] debug                          = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] default_availability_zone      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] default_group_type             = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] default_volume_type            = lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] driver_client_cert             = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] driver_client_cert_key         = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] driver_data_namespace          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] driver_ssl_cert_path           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] driver_ssl_cert_verify         = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] driver_use_ssl                 = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] enable_force_upload            = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] enable_new_services            = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] enable_unsupported_driver      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] enforce_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] filter_function                = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_api_insecure            = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_api_servers             = ['http://192.168.122.6/image'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_api_ssl_compression     = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_ca_certificates_file    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_certfile                = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_keyfile                 = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_num_retries             = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] glance_request_timeout         = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] goodness_function              = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] graceful_shutdown_timeout      = 5 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] group_api_class                = cinder.group.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] host                           = devstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_compress_on_upload       = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_conversion_address_space_limit = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_conversion_cpu_limit     = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_conversion_disable       = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_upload_use_cinder_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_upload_use_internal_tenant = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_volume_cache_enabled     = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_volume_cache_max_count   = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] image_volume_cache_max_size_gb = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] init_host_max_objects_retrieval = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iscsi_iotype                   = fileio {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iscsi_target_flags             =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iscsi_write_cache              = on {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iser_helper                    = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iser_ip_address                = 192.168.122.6 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iser_port                      = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_color                      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_config_append              = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_dir                        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_file                       = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_options                    = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_rotate_interval            = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_rotate_interval_type       = days {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] log_rotation_type              = none {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] max_age                        = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] max_logfile_count              = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] max_logfile_size_mb            = 200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] max_over_subscription_ratio    = 20.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] message_reap_interval          = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] message_ttl                    = 2592000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] migration_create_volume_timeout_secs = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] monkey_patch                   = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] monkey_patch_modules           = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] my_ip                          = 192.168.122.6 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] no_snapshot_gb_quota           = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] num_iser_scan_tries            = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] num_shell_tries                = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] num_volume_device_scan_tries   = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] nvmeof_conn_info_version       = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] nvmet_ns_id                    = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] nvmet_port_id                  = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_max_limit                = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_volume_ext_list          = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_volume_listen_port       = 8776 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_volume_use_ssl           = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] osapi_volume_workers           = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] per_volume_size_limit          = -1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] periodic_fuzzy_delay           = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] periodic_interval              = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] public_endpoint                = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] publish_errors                 = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_backup_gigabytes         = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_backups                  = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_gigabytes                = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_groups                   = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_snapshots                = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] quota_volumes                  = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] rate_limit_burst               = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] rate_limit_except_level        = CRITICAL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] rate_limit_interval            = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] reinit_driver_count            = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] replication_device             = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] report_discard_supported       = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] report_interval                = 120 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] reservation_clean_interval     = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] reservation_expire             = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] reserved_image_namespaces      = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] reserved_percentage            = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] rpc_response_timeout           = 120 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] run_external_periodic_tasks    = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] scst_target_driver             = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] scst_target_iqn_name           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_down_time              = 720 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] shell_completion               = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] snapshot_name_template         = snapshot-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] snapshot_same_host             = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] split_loggers                  = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] state_path                     = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] storage_availability_zone      = nova {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] storage_protocol               = iSCSI {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] syslog_log_facility            = LOG_USER {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] target_helper                  = lioadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] target_ip_address              = 192.168.122.6 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] target_port                    = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] target_protocol                = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] target_secondary_ip_addresses  = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] trace_flags                    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] transport_url                  = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] until_refresh                  = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_chap_auth                  = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_default_quota_class        = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_journal                    = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_json                       = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_multipath_for_image_xfer   = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_stderr                     = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] use_syslog                     = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] verify_glance_signatures       = enabled {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_api_class               = cinder.volume.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_backend_name            = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_clear                   = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_clear_ionice            = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_clear_size              = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_copy_bps_limit          = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_dd_blocksize            = 1M {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_name_template           = volume-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_service_inithost_offload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volume_usage_audit_period      = month {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] watch_log_file                 = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] zoning_mode                    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_concurrency.disable_process_locking = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.admin_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.admin_token = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.admin_user  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_port   = 35357 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_protocol = https {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_type   = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_uri    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.auth_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.cache       = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.certfile    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.identity_uri = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.include_service_catalog = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.insecure    = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.interface   = public {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.keyfile     = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_password =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcache_username =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.service_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.backend                  = dogpile.cache.null {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.backend_argument         = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.backend_expiration_time  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.config_prefix            = cache.oslo {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.dead_timeout             = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.debug_cache_backend      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.enable_retry_client      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.enable_socket_keepalive  = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.enabled                  = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.enforce_fips_mode        = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.expiration_time          = 600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.hashclient_retry_attempts = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_dead_retry      = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_password        = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_sasl_enabled    = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.memcache_username        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.proxies                  = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_db                 = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_password           = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_server             = localhost:6379 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_socket_timeout     = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.redis_username           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.retry_attempts           = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.retry_delay              = 0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.socket_keepalive_count   = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.socket_keepalive_idle    = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.socket_keepalive_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.158s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.tls_allowed_ciphers      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.tls_cafile               = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.tls_certfile             = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.tls_enabled              = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cache.tls_keyfile              = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] coordination.backend_url       = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.asyncio_connection    = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.asyncio_slave_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.backend               = sqlalchemy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.connection            = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.connection_debug      = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.connection_parameters =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.connection_recycle_time = 3600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.connection_trace      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.db_inc_retry_interval = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.db_max_retries        = 20 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.db_max_retry_interval = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.db_retry_interval     = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.max_overflow          = 50 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.max_pool_size         = 5 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.max_retries           = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.mysql_wsrep_sync_wait = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.pool_timeout          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.retry_interval        = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.slave_connection      = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.sqlite_synchronous    = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] database.use_db_reconnect      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.connection_string     = messaging:// {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.enabled               = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.es_doc_type           = notification {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.es_scroll_size        = 10000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.es_scroll_time        = 2m {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.filter_error_trace    = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.hmac_keys             = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.sentinel_service_name = mymaster {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.socket_timeout        = 0.1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.trace_requests        = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler.trace_sqlalchemy      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler_jaeger.process_tags   = {} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler_jaeger.service_name_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] profiler_otlp.service_name_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.enforce_new_defaults = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: WARNING oslo_config.cfg [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.enforce_scope      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.policy_default_rule = default {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.group          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.helper_command = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] privsep_osbrick.user           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.group         = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.helper_command = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] cinder_sys_admin.user          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.auth_section      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.auth_type         = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.certfile          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.collect_timing    = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.insecure          = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.keyfile           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.send_service_user_token = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.split_loggers     = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] service_user.timeout           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.chap_username =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.driver_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.extra_capabilities = {} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iscsi_target_flags =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iscsi_write_cache = on {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iser_port     = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.lvm_share_target = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.lvm_type      = auto {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.num_shell_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.report_discard_supported = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.reserved_percentage = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.target_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.target_port   = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.trace_flags   = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.unique_fqdn_network = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.use_chap_auth = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_clear  = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_clear_size = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_reports.file_event_handler = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_reports.log_dir           = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.backend_host       = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.chap_password      = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.chap_username      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.extra_capabilities = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.filter_function    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.goodness_function  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iser_helper        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iser_port          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.lvm_type           = auto {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.report_discard_supported = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.reserved_percentage = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.207s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.scst_target_driver = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.storage_protocol   = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.target_ip_address  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.target_port        = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.trace_flags        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_clear       = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] lvmdriver-1.volumes_dir        = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_notifications.driver = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_notifications.retry = -1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] key_manager.fixed_key          = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.barbican_api_version  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.barbican_endpoint     = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.barbican_endpoint_type = public {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.barbican_region_name  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.cafile                = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.certfile              = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.collect_timing        = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.insecure              = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.keyfile               = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.number_of_retries     = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.retry_delay           = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.send_service_user_token = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.split_loggers         = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.timeout               = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.verify_ssl            = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican.verify_ssl_path       = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.auth_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.cafile   = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.keyfile  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] barbican_service_user.timeout  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.approle_role_id          = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.approle_secret_id        = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.kv_mountpoint            = secret {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.kv_path                  = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.kv_version               = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.namespace                = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.root_token_id            = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.ssl_ca_crt_file          = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.timeout                  = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.use_ssl                  = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:16:39 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] ******************************************************************************** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.185s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:39 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:39 devstack sudo[76039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 17 07:16:39 devstack sudo[76039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:41 devstack sudo[76039]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:41 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.008s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:41 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:42 devstack sudo[76158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:16:42 devstack sudo[76158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:43 devstack sudo[76158]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:43 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.997s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:43 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:16:43 devstack cinder-volume[75976]: INFO cinder.brick.local_dev.lvm [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 17 07:16:43 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:44 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.080s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:44 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:44 devstack sudo[76255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:16:44 devstack sudo[76255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:46 devstack sudo[76255]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:46 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.029s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:46 devstack cinder-volume[75976]: DEBUG cinder.brick.local_dev.lvm [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75976) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 17 07:16:46 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:46 devstack sudo[76345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:16:46 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:48 devstack cinder-volume[75845]: DEBUG dbcounter [-] [75845] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75845) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:16:49 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:49 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.612s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:49 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:49 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.140s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:49 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:50 devstack sudo[76545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:16:50 devstack sudo[76545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:51 devstack sudo[76545]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:52 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.027s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:52 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:52 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.117s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:52 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:52 devstack sudo[76583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 17 07:16:52 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:54 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:54 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.027s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:54 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:54 devstack sudo[76614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:16:54 devstack sudo[76614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:56 devstack sudo[76614]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:57 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.698s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:57 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:57 devstack sudo[76674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:16:57 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:16:59 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root
Sep 17 07:16:59 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.719s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:16:59 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:16:59 devstack sudo[76679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:16:59 devstack sudo[76679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:02 devstack sudo[76679]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:02 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.860s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:02 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:02 devstack sudo[76695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:17:02 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:05 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:05 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.157s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:05 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:06 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.132s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:06 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:06 devstack sudo[76725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:17:06 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:08 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:08 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.476s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:08 devstack cinder-volume[75976]: INFO cinder.volume.drivers.lvm [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 17 07:17:08 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:08 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.091s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:08 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:08 devstack sudo[76838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:17:08 devstack sudo[76838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:10 devstack sudo[76838]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:10 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.918s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:10 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:17:10 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:10 devstack sudo[76912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:17:10 devstack sudo[76912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:12 devstack sudo[76912]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:12 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.085s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:12 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:12 devstack sudo[76987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:17:12 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:14 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:14 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.989s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:14 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:14 devstack sudo[76996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:17:14 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:16 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:16 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.000s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:16 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:16 devstack sudo[77001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:17:16 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:18 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:18 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.898s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:18 devstack cinder-volume[75976]: INFO cinder.volume.driver [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Driver hasn't implemented _init_vendor_properties()
Sep 17 07:17:18 devstack cinder-volume[75976]: DEBUG cinder.volume.driver [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75976) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Sep 17 07:17:18 devstack cinder-volume[75976]: DEBUG oslo_db.sqlalchemy.engines [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:17:18 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writer thread running {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 07:17:19 devstack cinder-volume[75976]: DEBUG cinder.db.sqlalchemy.api [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Building query based on filter {{(pid=75976) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 17 07:17:19 devstack cinder-volume[75976]: DEBUG cinder.image.image_utils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75976) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 17 07:17:19 devstack cinder-volume[75976]: INFO cinder.keymgr.migration [None req-74e6b1e4-fbd8-4b20-9c29-42b2ce3b5a43 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 17 07:17:19 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:17:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:19 devstack sudo[77006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:17:19 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:21 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.931s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:21 devstack sudo[77010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:17:21 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:23 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.359s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:23 devstack sudo[77102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:17:23 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:25 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.269s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:25 devstack sudo[77159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:17:25 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:27 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:27 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.973s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:27 devstack cinder-volume[75976]: DEBUG cinder.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Notifying Schedulers of capabilities ... {{(pid=75976) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:17:27 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Driver initialization completed successfully.
Sep 17 07:17:27 devstack cinder-volume[75976]: INFO cinder.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Initiating service 2 cleanup
Sep 17 07:17:28 devstack cinder-volume[75976]: INFO cinder.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Service 2 cleanup completed.
Sep 17 07:17:28 devstack cinder-volume[75976]: DEBUG cinder.service [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Creating RPC server for service cinder-volume {{(pid=75976) start /opt/stack/cinder/cinder/service.py:239}}
Sep 17 07:17:28 devstack cinder-volume[75976]: DEBUG cinder.service [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75976) start /opt/stack/cinder/cinder/service.py:245}}
Sep 17 07:17:28 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 17 07:17:28 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:17:28 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:28 devstack sudo[77162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:17:28 devstack sudo[77162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:30 devstack sudo[77162]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:30 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.017s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:30 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:30 devstack sudo[77165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:17:30 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:32 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:32 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.977s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:32 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:32 devstack sudo[77174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:17:32 devstack sudo[77174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:34 devstack sudo[77174]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:34 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.957s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:34 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:17:34 devstack sudo[77177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:17:34 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:17:36 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root
Sep 17 07:17:36 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.974s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:17:36 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-d432e3e9-1061-4ee4-86ff-bc4f64223c6a None None] Driver post RPC initialization completed successfully.
Sep 17 07:17:46 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:17:46 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:18:19 devstack cinder-volume[75976]: DEBUG oslo_service.periodic_task [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75976) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:18:19 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:18:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:18:19 devstack sudo[78159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:18:19 devstack sudo[78159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:18:22 devstack sudo[78159]: pam_unix(sudo:session): session closed for user root
Sep 17 07:18:22 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.624s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:18:22 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:18:22 devstack sudo[78164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:18:22 devstack sudo[78164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:18:24 devstack sudo[78164]: pam_unix(sudo:session): session closed for user root
Sep 17 07:18:24 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.090s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:18:24 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:18:24 devstack sudo[78170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:18:24 devstack sudo[78170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:18:26 devstack sudo[78170]: pam_unix(sudo:session): session closed for user root
Sep 17 07:18:26 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.628s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:18:26 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:18:27 devstack sudo[78182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:18:27 devstack sudo[78182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:18:29 devstack sudo[78182]: pam_unix(sudo:session): session closed for user root
Sep 17 07:18:29 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.207s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:18:29 devstack cinder-volume[75976]: DEBUG cinder.manager [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Notifying Schedulers of capabilities ... {{(pid=75976) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:19:19 devstack cinder-volume[75976]: DEBUG oslo_service.periodic_task [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75976) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:19:19 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:19:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:19:19 devstack sudo[78926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:19:19 devstack sudo[78926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:19:21 devstack sudo[78926]: pam_unix(sudo:session): session closed for user root
Sep 17 07:19:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.048s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:19:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:19:21 devstack sudo[78931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:19:21 devstack sudo[78931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:19:23 devstack sudo[78931]: pam_unix(sudo:session): session closed for user root
Sep 17 07:19:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.314s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:19:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:19:23 devstack sudo[78936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:19:23 devstack sudo[78936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:19:25 devstack sudo[78936]: pam_unix(sudo:session): session closed for user root
Sep 17 07:19:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.101s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:19:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:19:26 devstack sudo[78957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:19:26 devstack sudo[78957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:19:27 devstack sudo[78957]: pam_unix(sudo:session): session closed for user root
Sep 17 07:19:27 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.922s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:19:27 devstack cinder-volume[75976]: DEBUG cinder.manager [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Notifying Schedulers of capabilities ... {{(pid=75976) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:19:46 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:SELECT=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:19:46 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:UPDATE=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:20:19 devstack cinder-volume[75976]: DEBUG oslo_service.periodic_task [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75976) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:20:19 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:20:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:20:19 devstack sudo[80637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:20:19 devstack sudo[80637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:20:21 devstack sudo[80637]: pam_unix(sudo:session): session closed for user root
Sep 17 07:20:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.095s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:20:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:20:21 devstack sudo[80783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:20:21 devstack sudo[80783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:20:23 devstack sudo[80783]: pam_unix(sudo:session): session closed for user root
Sep 17 07:20:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.312s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:20:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:20:24 devstack sudo[80937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:20:24 devstack sudo[80937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:20:26 devstack sudo[80937]: pam_unix(sudo:session): session closed for user root
Sep 17 07:20:26 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.336s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:20:26 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:20:26 devstack sudo[81086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:20:26 devstack sudo[81086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:20:28 devstack sudo[81086]: pam_unix(sudo:session): session closed for user root
Sep 17 07:20:28 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.061s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:20:28 devstack cinder-volume[75976]: DEBUG cinder.manager [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Notifying Schedulers of capabilities ... {{(pid=75976) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:21:19 devstack cinder-volume[75976]: DEBUG oslo_service.periodic_task [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75976) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:21:19 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:21:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:21:19 devstack sudo[82229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:21:19 devstack sudo[82229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:21:21 devstack sudo[82229]: pam_unix(sudo:session): session closed for user root
Sep 17 07:21:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.082s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:21:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:21:21 devstack sudo[82235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:21:21 devstack sudo[82235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:21:23 devstack sudo[82235]: pam_unix(sudo:session): session closed for user root
Sep 17 07:21:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.058s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:21:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:21:23 devstack sudo[82243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:21:23 devstack sudo[82243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:21:25 devstack sudo[82243]: pam_unix(sudo:session): session closed for user root
Sep 17 07:21:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.938s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:21:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:21:25 devstack sudo[82249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:21:25 devstack sudo[82249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:21:28 devstack sudo[82249]: pam_unix(sudo:session): session closed for user root
Sep 17 07:21:28 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.560s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:21:28 devstack cinder-volume[75976]: DEBUG cinder.manager [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Notifying Schedulers of capabilities ... {{(pid=75976) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:21:46 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:SELECT=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:21:46 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:UPDATE=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:22:19 devstack cinder-volume[75976]: DEBUG oslo_service.periodic_task [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75976) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:22:19 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Updating volume stats {{(pid=75976) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 17 07:22:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:22:19 devstack sudo[82443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 17 07:22:19 devstack sudo[82443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:22:21 devstack sudo[82443]: pam_unix(sudo:session): session closed for user root
Sep 17 07:22:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.962s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:22:21 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:22:21 devstack sudo[82447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:22:21 devstack sudo[82447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:22:23 devstack sudo[82447]: pam_unix(sudo:session): session closed for user root
Sep 17 07:22:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.067s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:22:23 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:22:23 devstack sudo[82453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 17 07:22:23 devstack sudo[82453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:22:25 devstack sudo[82453]: pam_unix(sudo:session): session closed for user root
Sep 17 07:22:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.991s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:22:25 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:22:25 devstack sudo[82459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 17 07:22:25 devstack sudo[82459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:22:27 devstack sudo[82459]: pam_unix(sudo:session): session closed for user root
Sep 17 07:22:27 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.078s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:22:27 devstack cinder-volume[75976]: DEBUG cinder.manager [None req-daf8f4c1-7b98-4aeb-ae8f-9f89eb0fdfd8 None None] Notifying Schedulers of capabilities ... {{(pid=75976) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:23:13 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Caught SIGTERM, stopping children
Sep 17 07:23:13 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Acquiring lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 07:23:13 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Acquired lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 07:23:13 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Releasing lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 07:23:13 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Stop services. {{(pid=75845) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 17 07:23:13 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Killing children. {{(pid=75845) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 17 07:23:13 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Waiting on 1 children to exit
Sep 17 07:23:18 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Acquiring lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 07:23:18 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Acquired lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 07:23:18 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Releasing lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 07:23:18 devstack cinder-volume[75976]: WARNING amqp [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 17 07:23:18 devstack cinder-volume[75976]: WARNING amqp [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 17 07:23:18 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-680ffae0-ecfe-4194-8459-efd35c822543 None None] Child 75976 exited with status 0
Sep 17 07:23:36 devstack cinder-volume[83411]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83411) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 17 07:23:36 devstack cinder-volume[83411]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83411) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 17 07:23:36 devstack cinder-volume[83411]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83411) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 17 07:23:39 devstack cinder-volume[83411]: INFO dbcounter [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Registered counter for database cinder
Sep 17 07:23:39 devstack cinder-volume[83411]: DEBUG oslo_db.sqlalchemy.engines [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:23:40 devstack cinder-volume[83411]: DEBUG dbcounter [-] [83411] Writer thread running {{(pid=83411) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 07:23:40 devstack cinder-volume[83411]: INFO cinder.rpc [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 17 07:23:40 devstack cinder-volume[83411]: INFO cinder.rpc [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 17 07:23:40 devstack cinder-volume[83411]: DEBUG oslo_db.sqlalchemy.engines [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:23:40 devstack cinder-volume[83411]: INFO cinder.volume.manager [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Determined volume DB was empty at startup.
Sep 17 07:23:40 devstack cinder-volume[83411]: DEBUG cinder.volume.manager [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83411) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 17 07:23:40 devstack cinder-volume[83411]: INFO cinder.volume.manager [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 17 07:23:40 devstack cinder-volume[83411]: WARNING stevedore.named [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 17 07:23:40 devstack cinder-volume[83411]: WARNING castellan.key_manager [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 07:23:40 devstack cinder-volume[83411]: WARNING cinder.keymgr.conf_key_mgr [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 17 07:23:40 devstack cinder-volume[83411]: INFO cinder.volume.manager [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 17 07:23:40 devstack cinder-volume[83411]: DEBUG oslo_db.sqlalchemy.engines [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83411) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:23:40 devstack cinder-volume[83411]: INFO oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Starting 1 workers
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Started child 83645 {{(pid=83411) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Full set of CONF: {{(pid=83411) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] ******************************************************************************** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Configuration options gathered from: {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] ================================================================================ {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] allow_availability_zone_fallback = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] allow_compression_on_image_upload = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] allowed_direct_url_schemes     = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] api_rate_limit                 = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] auth_strategy                  = keystone {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_availability_zone      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_host                   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_name                   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_stats_polling_interval = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backup_api_class               = cinder.backup.api.API {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backup_name_template           = backup-%s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backup_use_same_host           = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backup_use_temp_snapshot       = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] chap_password                  = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] chap_username                  =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_internal_tenant_project_id = 70a0042174ef4d9fb18f2ec25b739678 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_internal_tenant_user_id = a21c086b33554dabb4494d7d5819206a {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cluster                        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] compression_format             = gzip {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] compute_api_class              = cinder.compute.nova.API {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] config_dir                     = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] config_source                  = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] control_exchange               = openstack {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] debug                          = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] default_availability_zone      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] default_group_type             = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] default_volume_type            = QuobyteHD {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] driver_client_cert             = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] driver_client_cert_key         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] driver_data_namespace          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] driver_ssl_cert_path           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] driver_ssl_cert_verify         = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] driver_use_ssl                 = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] enable_new_services            = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] enable_unsupported_driver      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] enabled_backends               = ['QuobyteHD'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] enforce_multipath_for_image_xfer = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] filter_function                = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_api_insecure            = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83645]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.1)
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_api_servers             = ['http://192.168.122.6/image'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_api_ssl_compression     = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_ca_certificates_file    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_catalog_info            = image:glance:publicURL {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_certfile                = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_keyfile                 = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_num_retries             = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] glance_request_timeout         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] goodness_function              = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] graceful_shutdown_timeout      = 5 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] group_api_class                = cinder.group.api.API {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] host                           = devstack {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_compress_on_upload       = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_conversion_address_space_limit = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_conversion_cpu_limit     = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_conversion_disable       = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_upload_use_cinder_backend = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_upload_use_internal_tenant = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_volume_cache_enabled     = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_volume_cache_max_count   = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] image_volume_cache_max_size_gb = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] init_host_max_objects_retrieval = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] instance_format                = [instance: %(uuid)s]  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iscsi_iotype                   = fileio {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iscsi_target_flags             =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iscsi_write_cache              = on {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iser_helper                    = tgtadm {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iser_ip_address                = 192.168.122.6 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iser_port                      = 3260 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_color                      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_config_append              = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_dir                        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_file                       = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_options                    = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_rotate_interval            = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_rotate_interval_type       = days {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] log_rotation_type              = none {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] max_age                        = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] max_logfile_count              = 30 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] max_logfile_size_mb            = 200 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] max_over_subscription_ratio    = 20.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] message_reap_interval          = 86400 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] message_ttl                    = 2592000 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] migration_create_volume_timeout_secs = 300 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] monkey_patch                   = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] monkey_patch_modules           = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] my_ip                          = 192.168.122.6 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] no_snapshot_gb_quota           = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] num_iser_scan_tries            = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] num_shell_tries                = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] num_volume_device_scan_tries   = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] nvmeof_conn_info_version       = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] nvmet_ns_id                    = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] nvmet_port_id                  = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_max_limit                = 1000 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_volume_ext_list          = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_volume_listen_port       = 8776 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_volume_use_ssl           = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] osapi_volume_workers           = 2 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] per_volume_size_limit          = -1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] periodic_fuzzy_delay           = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] periodic_interval              = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] public_endpoint                = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] publish_errors                 = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_backup_gigabytes         = 1000 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_backups                  = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_gigabytes                = 1000 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_groups                   = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_snapshots                = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] quota_volumes                  = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] rate_limit_burst               = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] rate_limit_except_level        = CRITICAL {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] rate_limit_interval            = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] reinit_driver_count            = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] replication_device             = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] report_discard_supported       = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] report_interval                = 120 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] reservation_clean_interval     = 86400 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] reservation_expire             = 86400 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] reserved_image_namespaces      = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] reserved_percentage            = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] rpc_response_timeout           = 120 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] run_external_periodic_tasks    = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] scst_target_driver             = iscsi {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] scst_target_iqn_name           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_down_time              = 720 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] shell_completion               = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] snapshot_name_template         = snapshot-%s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] split_loggers                  = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] state_path                     = /opt/stack/data/cinder {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] storage_availability_zone      = nova {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] storage_protocol               = iSCSI {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] syslog_log_facility            = LOG_USER {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] target_helper                  = lioadm {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] target_ip_address              = 192.168.122.6 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] target_port                    = 3260 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] target_protocol                = iscsi {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] target_secondary_ip_addresses  = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] trace_flags                    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] transport_url                  = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] until_refresh                  = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_chap_auth                  = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_default_quota_class        = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_journal                    = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_json                       = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_multipath_for_image_xfer   = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_stderr                     = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] use_syslog                     = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] verify_glance_signatures       = enabled {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_api_class               = cinder.volume.api.API {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_backend_name            = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_clear                   = zero {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_clear_ionice            = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_clear_size              = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_copy_bps_limit          = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_dd_blocksize            = 1M {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_name_template           = volume-%s {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_service_inithost_offload = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volume_usage_audit_period      = month {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] watch_log_file                 = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] zoning_mode                    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_concurrency.disable_process_locking = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.admin_password = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.admin_token = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.admin_user  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_port   = 35357 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_protocol = https {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_section = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_type   = password {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_uri    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.auth_version = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.cache       = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.certfile    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.delay_auth_decision = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.http_connect_timeout = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.identity_uri = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.include_service_catalog = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.insecure    = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.interface   = public {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.keyfile     = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_password =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcache_username =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.region_name = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.service_token_roles_required = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.service_type = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.token_cache_time = 300 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.backend                  = dogpile.cache.null {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.backend_argument         = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.backend_expiration_time  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.config_prefix            = cache.oslo {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.dead_timeout             = 60.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.debug_cache_backend      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.enable_retry_client      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.enable_socket_keepalive  = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.enabled                  = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.enforce_fips_mode        = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.expiration_time          = 600 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.hashclient_retry_attempts = 2 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_dead_retry      = 300 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_password        = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_pool_maxsize    = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_sasl_enabled    = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.memcache_username        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.proxies                  = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_db                 = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_password           = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_sentinel_service_name = mymaster {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_server             = localhost:6379 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_socket_timeout     = 1.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.redis_username           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.retry_attempts           = 2 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.retry_delay              = 0.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.socket_keepalive_count   = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.socket_keepalive_idle    = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.socket_keepalive_interval = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.tls_allowed_ciphers      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.tls_cafile               = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.tls_certfile             = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.tls_enabled              = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cache.tls_keyfile              = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] coordination.backend_url       = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.asyncio_connection    = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.asyncio_slave_connection = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.backend               = sqlalchemy {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.connection            = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.connection_debug      = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.connection_parameters =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.connection_recycle_time = 3600 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.connection_trace      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.db_inc_retry_interval = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.db_max_retries        = 20 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.db_max_retry_interval = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.db_retry_interval     = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.max_overflow          = 50 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.max_pool_size         = 5 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.max_retries           = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.mysql_wsrep_sync_wait = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.pool_timeout          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.retry_interval        = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.slave_connection      = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.sqlite_synchronous    = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] database.use_db_reconnect      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.connection_string     = messaging:// {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.enabled               = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.es_doc_type           = notification {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.es_scroll_size        = 10000 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.es_scroll_time        = 2m {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.filter_error_trace    = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.hmac_keys             = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.sentinel_service_name = mymaster {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.socket_timeout        = 0.1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.trace_requests        = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler.trace_sqlalchemy      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler_jaeger.process_tags   = {} {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler_jaeger.service_name_prefix = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] profiler_otlp.service_name_prefix = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.enforce_new_defaults = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: WARNING oslo_config.cfg [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.enforce_scope      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.policy_default_rule = default {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.policy_file        = policy.yaml {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.group          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.helper_command = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] privsep_osbrick.user           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.group         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.helper_command = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] cinder_sys_admin.user          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.auth_section      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.auth_type         = password {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.certfile          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.collect_timing    = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.insecure          = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.keyfile           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.send_service_user_token = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.split_loggers     = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] service_user.timeout           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.backend_availability_zone = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.chap_password = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.chap_username =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.driver_client_cert = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.driver_client_cert_key = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.driver_data_namespace = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.driver_use_ssl = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.enable_unsupported_driver = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.extra_capabilities = {} {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.filter_function = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.goodness_function = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iscsi_target_flags =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iscsi_write_cache = on {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iser_helper   = tgtadm {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iser_ip_address = 192.168.122.6 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iser_port     = 3260 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_host      =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_login     = admin {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_mount_options = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_password  = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_private_key =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_share_path =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.num_shell_tries = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.nvmet_port_id = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_client_cfg = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.quobyte_volume_url = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.replication_device = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.report_discard_supported = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.reserved_percentage = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.scst_target_driver = iscsi {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.scst_target_iqn_name = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.storage_protocol = iSCSI {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.target_helper = tgtadm {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.target_ip_address = 192.168.122.6 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.target_port   = 3260 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.target_protocol = iscsi {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.trace_flags   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.unique_fqdn_network = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.use_chap_auth = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_backend_name = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_clear  = zero {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_clear_ionice = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_clear_size = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_reports.file_event_handler = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_reports.log_dir           = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.backend_availability_zone = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.backend_host         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.chap_password        = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.chap_username        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.chiscsi_conf         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.driver_client_cert   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.driver_client_cert_key = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.driver_data_namespace = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.driver_use_ssl       = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.extra_capabilities   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.filter_function      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.goodness_function    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iscsi_iotype         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iser_helper          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iser_ip_address      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iser_port            = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.iser_target_prefix   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_host             = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_login            = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_mount_options    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_password         = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_private_key      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_share_path       = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_ssh_port         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.num_shell_tries      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.nvmet_port_id        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.replication_device   = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.report_discard_supported = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.reserved_percentage  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.scst_target_driver   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.storage_protocol     = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.target_helper        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.target_ip_address    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.target_port          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.target_prefix        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.target_protocol      = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.trace_flags          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.use_chap_auth        = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_clear         = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_clear_size    = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] QuobyteHD.volumes_dir          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.ssl      = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_notifications.driver = [] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_notifications.retry = -1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] oslo_messaging_notifications.transport_url = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] key_manager.fixed_key          = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.barbican_api_version  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.barbican_endpoint     = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.barbican_endpoint_type = public {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.barbican_region_name  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.cafile                = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.certfile              = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.collect_timing        = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.insecure              = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.keyfile               = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.number_of_retries     = 60 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.retry_delay           = 1 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.send_service_user_token = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.split_loggers         = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.timeout               = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.verify_ssl            = True {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican.verify_ssl_path       = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.auth_section = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.auth_type = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.cafile   = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.certfile = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.collect_timing = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.insecure = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.keyfile  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.split_loggers = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] barbican_service_user.timeout  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.approle_role_id          = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.approle_secret_id        = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.kv_mountpoint            = secret {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.kv_path                  = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.kv_version               = 2 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.namespace                = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.root_token_id            = **** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.ssl_ca_crt_file          = None {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.timeout                  = 60.0 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.use_ssl                  = False {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 17 07:23:41 devstack cinder-volume[83411]: DEBUG oslo_service.backend._eventlet.service [None req-7c4f1519-e652-4492-bfe6-16d87e84121c None None] ******************************************************************************** {{(pid=83411) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 17 07:23:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:23:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 17 07:23:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83645) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 17 07:23:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83645) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 17 07:23:41 devstack cinder-volume[83645]: INFO cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 17 07:23:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Running cmd (subprocess): mount.quobyte {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:23:42 devstack quobyte-client[83646]: Reading configuration file: /etc/quobyte/client.cfg
Sep 17 07:23:42 devstack quobyte-client[83646]: Invalid parameters found, error: missing mount point.
Sep 17 07:23:42 devstack quobyte-client[83646]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 17 07:23:42 devstack quobyte-client[83646]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 17 07:23:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] CMD "mount.quobyte" returned: 1 in 0.382s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:23:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:23:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:23:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:23:42 devstack cinder-volume[83645]: INFO cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Mounting volume: 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 ...
Sep 17 07:23:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 -c /etc/quobyte/client-cinder.cfg {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:23:42 devstack quobyte-client[83650]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 17 07:23:42 devstack quobyte-client[83650]: Reading configuration file: /etc/quobyte/client.cfg
Sep 17 07:23:42 devstack quobyte-client[83650]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9' to display the log.
Sep 17 07:23:42 devstack quobyte-client[83654]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 17 07:23:42 devstack quobyte-client[83654]: mount.quobyte 3.25 (4fbbd59204)
Sep 17 07:23:42 devstack quobyte-client[83654]: Client UUID: NvUhhU4a-yF79-9Rl5-rhoU-R3sTC3Dm3RWP
Sep 17 07:23:42 devstack quobyte-client[83654]: Registry: osci01.corp.quobyte.com:7861
Sep 17 07:23:42 devstack quobyte-client[83654]: Volume: cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:23:42 devstack quobyte-client[83654]: FUSE version: 316
Sep 17 07:23:42 devstack quobyte-client[83654]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 17 07:23:42 devstack quobyte-client[83654]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 17 07:23:42 devstack quobyte-client[83654]: Setting total object cache size to 3352297472 bytes
Sep 17 07:23:42 devstack quobyte-client[83654]: Using FUSE low-level API
Sep 17 07:23:42 devstack quobyte-client[83654]: Caching of uid/gid to user/group name mappings is enabled
Sep 17 07:23:42 devstack quobyte-client[83654]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 17 07:23:42 devstack quobyte-client[83654]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 17 07:23:42 devstack quobyte-client[83654]: HTTP server started on port 55000
Sep 17 07:23:42 devstack quobyte-client[83654]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 17 07:23:42 devstack quobyte-client[83654]: Mount point /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 established
Sep 17 07:23:42 devstack quobyte-client[83654]: TimeSync is running and remote sync every 60 seconds
Sep 17 07:23:42 devstack quobyte-client[83654]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 07:23:42 devstack quobyte-client[83654]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 07:23:42 devstack quobyte-client[83654]: Opening volume cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 (6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e)
Sep 17 07:23:42 devstack quobyte-client[83654]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 17 07:23:42 devstack quobyte-client[83654]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 07:23:42 devstack quobyte-client[83654]: Failed to invalidate inode: 38: Function not implemented
Sep 17 07:23:43 devstack quobyte-client[83654]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.772s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:23:43 devstack quobyte-client[83654]: Automatic minidump upload enabled by global system configuration
Sep 17 07:23:43 devstack quobyte-client[83654]: Announcing HTTP status server address 172.24.4.1
Sep 17 07:23:43 devstack quobyte-client[83654]: Registered as service (uuid NvUhhU4a-yF79-9Rl5-rhoU-R3sTC3Dm3RWP)
Sep 17 07:23:43 devstack quobyte-client[83654]: Quobyte Client running as pid 83654
Sep 17 07:23:43 devstack cinder-volume[83645]: INFO cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Mounting volume: 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 succeeded
Sep 17 07:23:43 devstack quobyte-client[83654]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 17 07:23:43 devstack quobyte-client[83654]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.855s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:23:43 devstack quobyte-client[83654]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:23:43 devstack cinder-volume[83645]: INFO cinder.volume.driver [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Driver hasn't implemented _init_vendor_properties()
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.volume.driver [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83645) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_db.sqlalchemy.engines [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83645) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writer thread running {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.db.sqlalchemy.api [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Building query based on filter {{(pid=83645) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83645) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 17 07:23:43 devstack cinder-volume[83645]: INFO cinder.keymgr.migration [None req-04396ca3-c733-4dcb-8d18-470e2297d925 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:23:43 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:23:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Driver initialization completed successfully.
Sep 17 07:23:44 devstack cinder-volume[83645]: INFO cinder.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Initiating service 3 cleanup
Sep 17 07:23:44 devstack cinder-volume[83645]: INFO cinder.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Service 3 cleanup completed.
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG cinder.service [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Creating RPC server for service cinder-volume {{(pid=83645) start /opt/stack/cinder/cinder/service.py:239}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG cinder.service [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83645) start /opt/stack/cinder/cinder/service.py:245}}
Sep 17 07:23:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 17 07:23:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:23:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:23:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.119s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:23:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-87ce0aa5-bf32-4e11-94bb-3f60f51e52c2 None None] Driver post RPC initialization completed successfully.
Sep 17 07:23:45 devstack quobyte-client[83654]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 17 07:23:51 devstack cinder-volume[83411]: DEBUG dbcounter [-] [83411] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83411) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:23:54 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:23:54 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:24:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:24:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.128s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:24:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:25:02 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:25:02 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Flow 'volume_create_manager' (d0821a3c-e16d-40f7-8272-2cab75a7572c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0227eeb8-45a9-4f76-bfde-e3314121db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0227eeb8-45a9-4f76-bfde-e3314121db56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-2136406080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63a0020-71e0-4d57-8b7a-87a614518569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa5de1a040f4a71b0bafbb6ba7c68a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:25:02Z,use_quota=True,user_id='05f063aa7e2f48e49b6699304c8d427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52851b11-f1dc-44bc-bc7e-a62d87a0dcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52851b11-f1dc-44bc-bc7e-a62d87a0dcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb0f2b0-a938-404c-84f9-ad8c2a0ca721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb0f2b0-a938-404c-84f9-ad8c2a0ca721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63a0020-71e0-4d57-8b7a-87a614518569', 'volume_name': 'volume-a63a0020-71e0-4d57-8b7a-87a614518569', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3aebdf-db9c-4b3c-9a6c-410ccc412d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3aebdf-db9c-4b3c-9a6c-410ccc412d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcbcbe5-6490-4a35-9c0e-707e3a8d8e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:25:03 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume a63a0020-71e0-4d57-8b7a-87a614518569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63a0020-71e0-4d57-8b7a-87a614518569', 'volume_size': 1}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-2136406080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63a0020-71e0-4d57-8b7a-87a614518569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa5de1a040f4a71b0bafbb6ba7c68a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:25:02Z,use_quota=True,user_id='05f063aa7e2f48e49b6699304c8d427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Creating volume a63a0020-71e0-4d57-8b7a-87a614518569 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:25:03 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:25:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:25:03 devstack quobyte-client[83654]: System call of process 83920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:25:04 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=2, name=volume-a63a0020-71e0-4d57-8b7a-87a614518569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:25:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569 1073741824" returned: 0 in 1.190s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:25:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:25:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569" returned: 0 in 0.148s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:25:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] <== create_volume: return (1416ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:25:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:25:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcbcbe5-6490-4a35-9c0e-707e3a8d8e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63a0020-71e0-4d57-8b7a-87a614518569', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:25:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b748dd4d-9b85-4992-bee2-975e41a53156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:25:05 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume volume-a63a0020-71e0-4d57-8b7a-87a614518569 (a63a0020-71e0-4d57-8b7a-87a614518569): created successfully
Sep 17 07:25:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b748dd4d-9b85-4992-bee2-975e41a53156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:25:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Flow 'volume_create_manager' (d0821a3c-e16d-40f7-8272-2cab75a7572c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:25:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-997a5d20-7f9f-43ae-8e16-3664f2000fd3 tempest-VolumesAssistedSnapshotsTest-403153898 None] Created volume successfully.
Sep 17 07:25:15 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:25:15 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.724s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:25:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:25:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:26:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Flow 'volume_create_manager' (e6cbe247-16f4-4161-801d-f64b40072e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3276d5b9-c99e-4ece-a9f1-ce98df3438f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3276d5b9-c99e-4ece-a9f1-ce98df3438f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-157032499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6ab903955c4243b412cd101ad6121b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:26:04Z,use_quota=True,user_id='9d1c15282f66462494c4743f978daff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6880eba-e4a6-472a-adca-0fc656b9c1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6880eba-e4a6-472a-adca-0fc656b9c1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb43e91-4f73-4f18-ab01-b64d31923363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb43e91-4f73-4f18-ab01-b64d31923363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e', 'volume_name': 'volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b423a7c4-d443-4948-b328-1dcb2f0b6b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b423a7c4-d443-4948-b328-1dcb2f0b6b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16aa6ac-f9e1-460e-95ad-6f860c572a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:26:04 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Volume 0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e', 'volume_size': 1}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-157032499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e6ab903955c4243b412cd101ad6121b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:26:04Z,use_quota=True,user_id='9d1c15282f66462494c4743f978daff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Creating volume 0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:26:04 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:26:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:26:05 devstack quobyte-client[83654]: System call of process 84810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:26:05 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=3, name=volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:26:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e 1073741824" returned: 0 in 1.567s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:26:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:26:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e" returned: 0 in 0.333s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:26:06 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] <== create_volume: return (2160ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:26:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:26:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16aa6ac-f9e1-460e-95ad-6f860c572a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:26:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106fc7a-2947-4503-bb7b-f9790d53e578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:26:07 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Volume volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e (0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e): created successfully
Sep 17 07:26:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106fc7a-2947-4503-bb7b-f9790d53e578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:26:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Flow 'volume_create_manager' (e6cbe247-16f4-4161-801d-f64b40072e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:26:07 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-b708d37c-689a-46b2-aa28-6500c9257eea tempest-VolumesAdminNegativeTest-521470824 None] Created volume successfully.
Sep 17 07:26:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Acquiring lock "cinder-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:26:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Lock "cinder-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e-delete_volume" acquired by "delete_volume" :: waited 0.261s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:26:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:26:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Acquiring lock "cinder-quobyte-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:26:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Lock "cinder-quobyte-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e" acquired by "delete_volume" :: waited 0.042s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:26:12 devstack cinder-volume[83645]: INFO oslo.privsep.daemon [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpd_x33p43/privsep.sock']
Sep 17 07:26:13 devstack sudo[84838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpd_x33p43/privsep.sock
Sep 17 07:26:13 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:26:21 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:26:22 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:26:28 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root
Sep 17 07:26:28 devstack cinder-volume[83645]: INFO oslo.privsep.daemon [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Spawned new privsep daemon via rootwrap
Sep 17 07:26:28 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Accepted privsep connection to /tmp/tmpd_x33p43/privsep.sock {{(pid=83645) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 17 07:26:28 devstack cinder-volume[83645]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 17 07:26:28 devstack cinder-volume[83645]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 17 07:26:28 devstack cinder-volume[83645]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 17 07:26:28 devstack cinder-volume[83645]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84910
Sep 17 07:26:28 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2271e32-a845-4d71-9679-f7832c17ff04]: (2,) {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:26:29 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71d3a8b-3b31-446b-baab-77fc3624c42b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:26:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:26:30 devstack quobyte-client[83654]: System call of process 84934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:26:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e" returned: 0 in 1.317s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:26:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:26:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e" returned: 0 in 0.256s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:26:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Lock "cinder-quobyte-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e" released by "delete_volume" :: held 18.306s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:26:32 devstack cinder-volume[83645]: WARNING cinder.quota [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:26:32 devstack cinder-volume[83645]: WARNING cinder.quota [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:26:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Created reservations ['4eff5d29-0032-43bf-8c0c-31ffb0f00919', 'a1ad0ff4-915f-41a3-adf0-7cb44242a142', 'bfbf51fd-e0bf-4837-9c88-4e0649925861', 'f86044b8-7c4b-45d9-b462-f2c18488f24a'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:26:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:26:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:26:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:26:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:26:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:26:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:26:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.496s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:26:34 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:26:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Deleted volume successfully.
Sep 17 07:26:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c46045d4-f43c-4fd1-8afc-3e99166333ca tempest-VolumesAdminNegativeTest-521470824 None] Lock "cinder-0e40ad8d-e8de-49d4-8d7f-dd62702a6b0e-delete_volume" released by "delete_volume" :: held 23.658s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:26:43 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=11 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.848s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:26:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:27:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Flow 'volume_create_manager' (12643f21-386c-4fe7-9c71-6bbcf93b0e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c290e00-3750-4041-9592-bfa230b6cb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c290e00-3750-4041-9592-bfa230b6cb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-446837498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35fdcbc-55b5-4fcc-8247-61db0d06af9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d66819aaf54e91a077c70cac6fc25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:27:27Z,use_quota=True,user_id='4ccd06d09e34432d9087c25795af73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2b5d08-ba2c-4c84-bf49-c810fc820c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2b5d08-ba2c-4c84-bf49-c810fc820c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6de4fa-aa5c-4313-9104-5da6fe52bf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6de4fa-aa5c-4313-9104-5da6fe52bf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35fdcbc-55b5-4fcc-8247-61db0d06af9b', 'volume_name': 'volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a69c83-eea6-40a6-862d-43ff9c4afefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a69c83-eea6-40a6-862d-43ff9c4afefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba48ac5-0038-4c26-8270-43de24b604ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:27:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume f35fdcbc-55b5-4fcc-8247-61db0d06af9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b', 'volume_size': 1}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-446837498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35fdcbc-55b5-4fcc-8247-61db0d06af9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d66819aaf54e91a077c70cac6fc25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:27:27Z,use_quota=True,user_id='4ccd06d09e34432d9087c25795af73b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Creating volume f35fdcbc-55b5-4fcc-8247-61db0d06af9b {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:27:27 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:27:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:27:27 devstack quobyte-client[83654]: System call of process 85178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:27:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=4, name=volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b 1073741824" returned: 0 in 0.465s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" returned: 0 in 0.130s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] <== create_volume: return (708ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba48ac5-0038-4c26-8270-43de24b604ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ca0983-8c04-4ce6-b2b7-8932335c33d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:27:28 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b (f35fdcbc-55b5-4fcc-8247-61db0d06af9b): created successfully
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ca0983-8c04-4ce6-b2b7-8932335c33d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:27:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Flow 'volume_create_manager' (12643f21-386c-4fe7-9c71-6bbcf93b0e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:27:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-71b33c6a-09ac-4723-8d42-f00c4fb9acfb tempest-AttachSCSIVolumeTestJSON-945825163 None] Created volume successfully.
Sep 17 07:27:38 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:27:39 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:27:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:27:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:27:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:27:42 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4237c2d-bf83-4992-a3e7-060dc3164909]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:27:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:27:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569" returned: 0 in 0.818s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.068s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fda71d-ef85-4050-a4fb-46a7e4fd0b96]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-a63a0020-71e0-4d57-8b7a-87a614518569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c62b8bb0-4748-4e46-b65a-a4c98b7fb2b4', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:27:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" returned: 0 in 0.657s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:27:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:27:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-92acb074-6e82-451f-ad05-94d6a3d8d8d2 req-c6025b63-e782-41f9-af23-8f4c8ee5f330 tempest-VolumesAssistedSnapshotsTest-403153898 None] attachment_update completed successfully.
Sep 17 07:27:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55864a37-85c2-40e4-8a5a-623e707d454a', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:27:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:27:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-0b77b233-be33-4f91-aace-3f974fce4ee3 req-947ff67f-fb81-4e8a-864b-9157be762ab1 tempest-AttachSCSIVolumeTestJSON-945825163 None] attachment_update completed successfully.
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.245s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:27:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:27:54 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:27:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:28:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-c715b3b9-a570-428e-b1e3-ec059f066898 req-99261184-e39c-4f1d-a841-962fb7bf35e7 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:28:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-c715b3b9-a570-428e-b1e3-ec059f066898 req-99261184-e39c-4f1d-a841-962fb7bf35e7 tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:28:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-c715b3b9-a570-428e-b1e3-ec059f066898 req-99261184-e39c-4f1d-a841-962fb7bf35e7 tempest-VolumesAssistedSnapshotsTest-403153898 None] Terminate volume connection completed successfully.
Sep 17 07:28:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c715b3b9-a570-428e-b1e3-ec059f066898 req-99261184-e39c-4f1d-a841-962fb7bf35e7 tempest-VolumesAssistedSnapshotsTest-403153898 None] Deleting attachment c62b8bb0-4748-4e46-b65a-a4c98b7fb2b4. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:28:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-04e5cc74-b357-41f7-b64d-3eb783878961 req-5fe51cbc-a2aa-49c5-9bfc-36fc5a99aaca tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:28:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-04e5cc74-b357-41f7-b64d-3eb783878961 req-5fe51cbc-a2aa-49c5-9bfc-36fc5a99aaca tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:28:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-04e5cc74-b357-41f7-b64d-3eb783878961 req-5fe51cbc-a2aa-49c5-9bfc-36fc5a99aaca tempest-AttachSCSIVolumeTestJSON-945825163 None] Terminate volume connection completed successfully.
Sep 17 07:28:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-04e5cc74-b357-41f7-b64d-3eb783878961 req-5fe51cbc-a2aa-49c5-9bfc-36fc5a99aaca tempest-AttachSCSIVolumeTestJSON-945825163 None] Deleting attachment 55864a37-85c2-40e4-8a5a-623e707d454a. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:28:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Acquiring lock "cinder-a63a0020-71e0-4d57-8b7a-87a614518569-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:28:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "cinder-a63a0020-71e0-4d57-8b7a-87a614518569-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:28:21 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:28:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Acquiring lock "cinder-quobyte-a63a0020-71e0-4d57-8b7a-87a614518569" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:28:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "cinder-quobyte-a63a0020-71e0-4d57-8b7a-87a614518569" acquired by "delete_volume" :: waited 0.087s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:28:21 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9167b47-3797-4294-87e9-17b508733098]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:28:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:28:23 devstack quobyte-client[83654]: System call of process 85837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:28:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569" returned: 0 in 1.587s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:28:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:28:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a63a0020-71e0-4d57-8b7a-87a614518569" returned: 0 in 0.357s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:28:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "cinder-quobyte-a63a0020-71e0-4d57-8b7a-87a614518569" released by "delete_volume" :: held 2.560s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:28:24 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Created reservations ['94db60d2-6c96-4b43-b5c7-2ee286a98039', '2ac39b25-51fc-4ec9-85aa-5e05a1519ef9', 'e45b2f82-e9db-4de9-8760-b9481d106281', '4d741e63-751a-4498-a23f-59c60be41f83'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.262s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:28:25 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:28:26 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Deleted volume successfully.
Sep 17 07:28:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ab4a9c3f-14fb-4b06-9178-1e2bf40d265b tempest-VolumesAssistedSnapshotsTest-403153898 None] Lock "cinder-a63a0020-71e0-4d57-8b7a-87a614518569-delete_volume" released by "delete_volume" :: held 7.258s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:28:35 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:28:38 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:28:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Acquiring lock "cinder-f35fdcbc-55b5-4fcc-8247-61db0d06af9b-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:28:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "cinder-f35fdcbc-55b5-4fcc-8247-61db0d06af9b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:28:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:28:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Acquiring lock "cinder-quobyte-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:28:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "cinder-quobyte-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" acquired by "delete_volume" :: waited 0.050s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:28:48 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[382a5cf2-2e78-42d6-81a3-1a558800ea75]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:28:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:28:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" returned: 0 in 0.954s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:28:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:28:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" returned: 0 in 0.188s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:28:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "cinder-quobyte-f35fdcbc-55b5-4fcc-8247-61db0d06af9b" released by "delete_volume" :: held 1.592s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:28:50 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Created reservations ['62577940-e90f-4dc2-b1d5-738f0718dc0a', 'afa7ba80-d774-46d7-a919-6a977d83da22', '346dcc2c-24d8-4b95-9523-d588d3672f70', '8c7d5736-5184-4013-8844-da89c6c3e1f4'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.278s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:28:51 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:28:51 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Deleted volume successfully.
Sep 17 07:28:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e39726a-067e-42d6-9cc3-dbee3ee51775 tempest-AttachSCSIVolumeTestJSON-945825163 None] Lock "cinder-f35fdcbc-55b5-4fcc-8247-61db0d06af9b-delete_volume" released by "delete_volume" :: held 4.779s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:29:01 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:29:02 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:29:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Flow 'volume_create_manager' (f543b4a2-ea2c-4c16-a33e-57826143a791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c23658-743e-40b2-a8bc-1f387ee2037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c23658-743e-40b2-a8bc-1f387ee2037a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928851645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6ee1d35c394b55a17407c12866e4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:29:18Z,use_quota=True,user_id='5a6d058eed99420bacb76c3edde7b369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af83d2f-b508-4d59-a5f8-0d2a5b0442dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af83d2f-b508-4d59-a5f8-0d2a5b0442dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c57ec66-7f6c-4600-93a2-7a7f77f9e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c57ec66-7f6c-4600-93a2-7a7f77f9e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c', 'volume_name': 'volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88657ec-67ee-44c0-ae43-a3eb56d9f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88657ec-67ee-44c0-ae43-a3eb56d9f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4751c1-2575-49c6-8d02-49a306d33ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:18 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Volume 1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c', 'volume_size': 1}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928851645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6ee1d35c394b55a17407c12866e4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:29:18Z,use_quota=True,user_id='5a6d058eed99420bacb76c3edde7b369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Creating volume 1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:29:18 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:18 devstack quobyte-client[83654]: System call of process 86141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:29:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=5, name=volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c 1073741824" returned: 0 in 0.535s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c" returned: 0 in 0.245s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] <== create_volume: return (923ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b4751c1-2575-49c6-8d02-49a306d33ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7345e8b6-0aa4-4b59-8407-9abc25d0eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:19 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Volume volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c (1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c): created successfully
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7345e8b6-0aa4-4b59-8407-9abc25d0eeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Flow 'volume_create_manager' (f543b4a2-ea2c-4c16-a33e-57826143a791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:29:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-59439181-2f63-41d8-a745-51f9f9b967b2 tempest-ServersNegativeTestJSON-1897139376 None] Created volume successfully.
Sep 17 07:29:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Flow 'volume_create_manager' (29decb81-7620-42b1-8b0e-55ec58d367e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c72dc8-a53b-457c-b0fd-1433778b876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c72dc8-a53b-457c-b0fd-1433778b876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-738313137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9356cb-801f-4714-8dcf-8a179e759185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6ee1d35c394b55a17407c12866e4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:29:26Z,use_quota=True,user_id='5a6d058eed99420bacb76c3edde7b369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff56043-449b-4d50-af90-6835e2279bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff56043-449b-4d50-af90-6835e2279bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baacba30-f96c-4d3e-963b-ba2a9fe91a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baacba30-f96c-4d3e-963b-ba2a9fe91a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9356cb-801f-4714-8dcf-8a179e759185', 'volume_name': 'volume-6b9356cb-801f-4714-8dcf-8a179e759185', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e630dc-f3dc-4963-a579-fa262ac93bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e630dc-f3dc-4963-a579-fa262ac93bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe034bf-59c3-49f6-8675-223bfc18b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:26 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Volume 6b9356cb-801f-4714-8dcf-8a179e759185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9356cb-801f-4714-8dcf-8a179e759185', 'volume_size': 1}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-738313137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9356cb-801f-4714-8dcf-8a179e759185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6ee1d35c394b55a17407c12866e4b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:29:26Z,use_quota=True,user_id='5a6d058eed99420bacb76c3edde7b369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Creating volume 6b9356cb-801f-4714-8dcf-8a179e759185 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:29:26 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:29:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:26 devstack quobyte-client[83654]: System call of process 86195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:29:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=6, name=volume-6b9356cb-801f-4714-8dcf-8a179e759185, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:29:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185 1073741824" returned: 0 in 0.481s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185" returned: 0 in 0.271s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] <== create_volume: return (853ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:29:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe034bf-59c3-49f6-8675-223bfc18b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9356cb-801f-4714-8dcf-8a179e759185', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf83d1f-7e65-4ef8-b2a7-39ba5993c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:29:28 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Volume volume-6b9356cb-801f-4714-8dcf-8a179e759185 (6b9356cb-801f-4714-8dcf-8a179e759185): created successfully
Sep 17 07:29:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf83d1f-7e65-4ef8-b2a7-39ba5993c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:29:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Flow 'volume_create_manager' (29decb81-7620-42b1-8b0e-55ec58d367e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:29:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ef5ddff7-11da-40e6-98df-ad920ff72f1d tempest-ServersNegativeTestJSON-1897139376 None] Created volume successfully.
Sep 17 07:29:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "cinder-6b9356cb-801f-4714-8dcf-8a179e759185-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:29:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-6b9356cb-801f-4714-8dcf-8a179e759185-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:29:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:29:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "cinder-quobyte-6b9356cb-801f-4714-8dcf-8a179e759185" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:29:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-quobyte-6b9356cb-801f-4714-8dcf-8a179e759185" acquired by "delete_volume" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:29:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eabb5d3-6098-49ef-b07f-96683781f50e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:29:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185" returned: 0 in 0.624s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b9356cb-801f-4714-8dcf-8a179e759185" returned: 0 in 0.093s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-quobyte-6b9356cb-801f-4714-8dcf-8a179e759185" released by "delete_volume" :: held 0.885s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Created reservations ['c87eb83e-b27b-4a23-aacd-9745b809a911', '288c49d0-0017-410c-b9e8-457896eb6d2b', 'a5da78c9-6d85-4138-8e4f-b6b868e13876', '686c612a-e9c4-47fa-968c-073059d24ef9'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.118s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:32 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:29:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Deleted volume successfully.
Sep 17 07:29:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2d020e3f-9487-487b-9511-9bac910b1042 tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-6b9356cb-801f-4714-8dcf-8a179e759185-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:29:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "cinder-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:29:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:29:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:29:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "cinder-quobyte-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:29:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-quobyte-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c" acquired by "delete_volume" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:29:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9896bfa0-4cb8-40cd-aec3-4f39c5da07ce]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:29:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c" returned: 0 in 0.888s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c" returned: 0 in 0.301s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-quobyte-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c" released by "delete_volume" :: held 1.601s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Created reservations ['7ae6b64b-c4ae-427d-93c1-b5359600275e', '1e438a50-4365-4952-b502-9103f70901b9', '2e4d91c9-0151-4191-afa2-49f85b9e8355', '7b3082a0-b27b-4117-98be-b26a44e07477'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.129s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:35 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:29:35 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Deleted volume successfully.
Sep 17 07:29:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9acc4615-7d55-41b0-bdf3-ba9616b950ef tempest-ServersNegativeTestJSON-1897139376 None] Lock "cinder-1eb6b359-0971-4d74-ae4a-4fd1f2b77b4c-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=9,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.396s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:29:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:29:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=16,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:30:20 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Flow 'volume_create_manager' (213bdda4-6067-4516-9b0c-6fbc406a7e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dcbfc0-9be1-4bd3-ad3c-a06470d14ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dcbfc0-9be1-4bd3-ad3c-a06470d14ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-42574046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a776e016-fcce-42c2-9bcc-33627822beab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aab25e55e2034a2a9b2f06e071841ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:20Z,use_quota=True,user_id='47236f71d1ff41b1b1acdcc38c0dbcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c17516-e104-4016-b93f-355f05ed99f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c17516-e104-4016-b93f-355f05ed99f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a849161d-91c5-40c6-8d75-756c51a77a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a849161d-91c5-40c6-8d75-756c51a77a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a776e016-fcce-42c2-9bcc-33627822beab', 'volume_name': 'volume-a776e016-fcce-42c2-9bcc-33627822beab', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230bc1ad-fadf-45da-875e-3547eb734c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230bc1ad-fadf-45da-875e-3547eb734c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb32dd8-cd25-4c1b-983f-5c8dcc66f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:20 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Volume a776e016-fcce-42c2-9bcc-33627822beab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a776e016-fcce-42c2-9bcc-33627822beab', 'volume_size': 1}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-42574046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a776e016-fcce-42c2-9bcc-33627822beab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aab25e55e2034a2a9b2f06e071841ae5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:20Z,use_quota=True,user_id='47236f71d1ff41b1b1acdcc38c0dbcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Creating volume a776e016-fcce-42c2-9bcc-33627822beab {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:30:20 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:30:20 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=7, name=volume-a776e016-fcce-42c2-9bcc-33627822beab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:30:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab 1073741824" returned: 0 in 0.505s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab" returned: 0 in 0.153s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] <== create_volume: return (795ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb32dd8-cd25-4c1b-983f-5c8dcc66f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a776e016-fcce-42c2-9bcc-33627822beab', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535d6354-6498-4044-99ee-43ba307de499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:21 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Volume volume-a776e016-fcce-42c2-9bcc-33627822beab (a776e016-fcce-42c2-9bcc-33627822beab): created successfully
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535d6354-6498-4044-99ee-43ba307de499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Flow 'volume_create_manager' (213bdda4-6067-4516-9b0c-6fbc406a7e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:30:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0a369ede-60d0-4721-9919-235c43dfafab tempest-TaggedAttachmentsTest-1691834373 None] Created volume successfully.
Sep 17 07:30:31 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:30:31 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:30:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:30:33 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:30:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Flow 'volume_create_manager' (dba12b56-70e5-4166-848c-256eb2cbb47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:30:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c3cd09-e64c-42f8-8a46-87ee39554357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c3cd09-e64c-42f8-8a46-87ee39554357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1546555381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622641c4-8d98-4034-85da-b79cf2fd98cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eaa16ff7a0a4155a74208257d3768e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:33Z,use_quota=True,user_id='918bcd86b9014575a2cf71ab616d8b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08658caf-aa4d-482c-bcab-ec13c80a63d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08658caf-aa4d-482c-bcab-ec13c80a63d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd6de37-c969-4aa4-bbd7-d064f7000847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd6de37-c969-4aa4-bbd7-d064f7000847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622641c4-8d98-4034-85da-b79cf2fd98cc', 'volume_name': 'volume-622641c4-8d98-4034-85da-b79cf2fd98cc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f181c482-f738-4103-bd72-0f7848fe5f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f181c482-f738-4103-bd72-0f7848fe5f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310df3e7-b79c-4380-a298-61f3e21227d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:34 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Volume 622641c4-8d98-4034-85da-b79cf2fd98cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622641c4-8d98-4034-85da-b79cf2fd98cc', 'volume_size': 1}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1546555381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622641c4-8d98-4034-85da-b79cf2fd98cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eaa16ff7a0a4155a74208257d3768e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:33Z,use_quota=True,user_id='918bcd86b9014575a2cf71ab616d8b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Creating volume 622641c4-8d98-4034-85da-b79cf2fd98cc {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:30:34 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:30:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:30:34 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=8, name=volume-622641c4-8d98-4034-85da-b79cf2fd98cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:30:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc 1073741824" returned: 0 in 0.839s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:30:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:30:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc" returned: 0 in 0.518s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:30:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] <== create_volume: return (1529ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:30:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:30:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310df3e7-b79c-4380-a298-61f3e21227d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622641c4-8d98-4034-85da-b79cf2fd98cc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b282befb-e68d-4cfb-810b-3435ef64ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:30:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Volume volume-622641c4-8d98-4034-85da-b79cf2fd98cc (622641c4-8d98-4034-85da-b79cf2fd98cc): created successfully
Sep 17 07:30:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b282befb-e68d-4cfb-810b-3435ef64ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:30:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Flow 'volume_create_manager' (dba12b56-70e5-4166-848c-256eb2cbb47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:30:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3653aab4-74a8-4156-9377-d20b986a3a8d tempest-DeleteServersTestJSON-2024724596 None] Created volume successfully.
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.263s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:30:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:30:46 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:30:46 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:30:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:30:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:30:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3b17a-578a-4f00-9eaf-8ac24d75e7f2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:30:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:30:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc" returned: 0 in 1.146s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:30:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.364s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:30:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-622641c4-8d98-4034-85da-b79cf2fd98cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daade718-0cd2-4d7e-a21d-12b5357f5de0', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:30:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:30:52 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-ee048efb-2eae-4678-a8f7-28fbbf0ff261 req-5c99f0c4-5e68-435c-82ae-abb8b66a4d00 tempest-DeleteServersTestJSON-2024724596 None] attachment_update completed successfully.
Sep 17 07:31:02 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:31:02 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:31:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-2f9f3260-25e8-4a48-8c79-1865e20855a2 req-8c6a9663-e5f9-441d-98c7-02d3fce01894 tempest-DeleteServersTestJSON-2024724596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:31:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-2f9f3260-25e8-4a48-8c79-1865e20855a2 req-8c6a9663-e5f9-441d-98c7-02d3fce01894 tempest-DeleteServersTestJSON-2024724596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:31:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-2f9f3260-25e8-4a48-8c79-1865e20855a2 req-8c6a9663-e5f9-441d-98c7-02d3fce01894 tempest-DeleteServersTestJSON-2024724596 None] Terminate volume connection completed successfully.
Sep 17 07:31:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-2f9f3260-25e8-4a48-8c79-1865e20855a2 req-8c6a9663-e5f9-441d-98c7-02d3fce01894 tempest-DeleteServersTestJSON-2024724596 None] Deleting attachment daade718-0cd2-4d7e-a21d-12b5357f5de0. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:31:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Acquiring lock "cinder-622641c4-8d98-4034-85da-b79cf2fd98cc-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:31:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Lock "cinder-622641c4-8d98-4034-85da-b79cf2fd98cc-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:31:23 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:31:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Acquiring lock "cinder-quobyte-622641c4-8d98-4034-85da-b79cf2fd98cc" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:31:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Lock "cinder-quobyte-622641c4-8d98-4034-85da-b79cf2fd98cc" acquired by "delete_volume" :: waited 0.060s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:31:23 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeaa9ff-0580-4fba-a007-63aadc6d495d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:31:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:31:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc" returned: 0 in 1.524s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:31:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:31:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-622641c4-8d98-4034-85da-b79cf2fd98cc" returned: 0 in 0.229s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:31:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Lock "cinder-quobyte-622641c4-8d98-4034-85da-b79cf2fd98cc" released by "delete_volume" :: held 2.315s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:31:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Created reservations ['7bf159fd-677e-474a-904f-3051f7ea5dc1', 'fc7a16df-3e7c-46d9-9daf-4e8584024b3f', '87a3205d-6dfd-44be-8675-d5d7bcd28b42', '3b81a638-ef7f-4a41-8a37-5c7a518e4e7d'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.550s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:31:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:31:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Deleted volume successfully.
Sep 17 07:31:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-14d72baf-1e73-4c9e-8f52-2144cd245843 tempest-DeleteServersTestJSON-2024724596 None] Lock "cinder-622641c4-8d98-4034-85da-b79cf2fd98cc-delete_volume" released by "delete_volume" :: held 5.840s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:31:37 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:31:38 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=3,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.652s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:31:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:31:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:31:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:32:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:32:18 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:32:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Flow 'volume_create_manager' (60f74337-2c2b-487d-b584-cff9a29f2b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf3cec8-2202-4a88-94ce-929dffa0a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf3cec8-2202-4a88-94ce-929dffa0a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1139787265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3a0f71-055b-43ca-9003-70a0a7f91fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfdc973f3f6436b85d26d50f37886d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:19Z,use_quota=True,user_id='b07811ba9f324d7bb0c0c73c64703e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04036bf0-2c8a-49bf-9830-bdfae6147ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04036bf0-2c8a-49bf-9830-bdfae6147ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f2b921-d1c7-4240-a76b-37a96990a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f2b921-d1c7-4240-a76b-37a96990a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2f3a0f71-055b-43ca-9003-70a0a7f91fd5', 'volume_name': 'volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c90693640>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bed8c87-0cf2-4e24-b902-6b0c92e2aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bed8c87-0cf2-4e24-b902-6b0c92e2aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8e2c9e-eb6d-41a5-a00a-7a48935fc341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:20 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Volume 2f3a0f71-055b-43ca-9003-70a0a7f91fd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c90693640>}
Sep 17 07:32:20 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Cloning 2f3a0f71-055b-43ca-9003-70a0a7f91fd5 from image f78f338c-82d6-4001-a9f8-06473b1187dc  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 07:32:21 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 07:32:21 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 07:32:21 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2bc0f7-4981-43ab-a667-6f59d434daf8]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:21 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD
Sep 17 07:32:21 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:32:24 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD" returned: 0 in 3.467s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc is fetched for user b07811ba9f324d7bb0c0c73c64703e51. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 07:32:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Flow 'volume_create_manager' (7c78fb8b-1157-481b-b06d-ddfbce528c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea24b213-1707-4433-95af-db11fe01221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea24b213-1707-4433-95af-db11fe01221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-693599838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba59489-0c3e-4120-b775-3f49542e5643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4971a4ba4d464cd2868cf8f5cfb632de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:24Z,use_quota=True,user_id='07fd72e6b737485ba307ceab7e39f4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761e573f-49fa-4408-b934-42f5e3fdac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (761e573f-49fa-4408-b934-42f5e3fdac0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52224ccb-b7b7-45ef-af04-5c5fa95d0d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52224ccb-b7b7-45ef-af04-5c5fa95d0d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba59489-0c3e-4120-b775-3f49542e5643', 'volume_name': 'volume-fba59489-0c3e-4120-b775-3f49542e5643', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3879de4-cc80-4813-9df7-391385db083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3879de4-cc80-4813-9df7-391385db083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548e1c1f-e4b3-4a41-8947-f67d79682a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:24 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Volume fba59489-0c3e-4120-b775-3f49542e5643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba59489-0c3e-4120-b775-3f49542e5643', 'volume_size': 1}
Sep 17 07:32:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-693599838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba59489-0c3e-4120-b775-3f49542e5643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4971a4ba4d464cd2868cf8f5cfb632de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:24Z,use_quota=True,user_id='07fd72e6b737485ba307ceab7e39f4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Creating volume fba59489-0c3e-4120-b775-3f49542e5643 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:32:25 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:32:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:25 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=9, name=volume-fba59489-0c3e-4120-b775-3f49542e5643, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643 1073741824" returned: 0 in 1.104s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e84c8-5e92-42c7-a27a-795645211701]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643" returned: 0 in 0.453s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] <== create_volume: return (1756ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:32:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548e1c1f-e4b3-4a41-8947-f67d79682a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba59489-0c3e-4120-b775-3f49542e5643', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5517054d-b786-4b49-a95d-9164e90fee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Volume volume-fba59489-0c3e-4120-b775-3f49542e5643 (fba59489-0c3e-4120-b775-3f49542e5643): created successfully
Sep 17 07:32:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5517054d-b786-4b49-a95d-9164e90fee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Flow 'volume_create_manager' (7c78fb8b-1157-481b-b06d-ddfbce528c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-72a6dbce-4fe5-42a7-926e-89981021c49c tempest-AttachVolumeTestJSON-1136610169 None] Created volume successfully.
Sep 17 07:32:27 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD
Sep 17 07:32:27 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:32:30 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD" returned: 0 in 3.783s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1139787265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f3a0f71-055b-43ca-9003-70a0a7f91fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfdc973f3f6436b85d26d50f37886d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:19Z,use_quota=True,user_id='b07811ba9f324d7bb0c0c73c64703e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Creating volume 2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:32:30 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:30 devstack quobyte-client[83654]: System call of process 87364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:32:30 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=10, name=volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:32:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 1073741824" returned: 0 in 0.455s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 0 in 0.194s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Attempting download of f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 2f3a0f71-055b-43ca-9003-70a0a7f91fd5. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[53306c25-6cda-402f-9cec-5465f2b0d1af]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_w1vcupml {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_w1vcupml" returned: 0 in 0.552s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_w1vcupml {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_w1vcupml" returned: 1 in 0.676s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_w1vcupml' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:32:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f92f7-55f3-4bce-a0a7-7d8222d9d6b8]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.037s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96765ee-23d0-45bd-ba33-040b61e823ed]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD" returned: 0 in 0.960s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] f78f338c-82d6-4001-a9f8-06473b1187dc was qcow2, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 07:32:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:34 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=10, name=volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:32:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643" returned: 0 in 0.811s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-fba59489-0c3e-4120-b775-3f49542e5643', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cb03054-f2bc-4ac9-a9b9-329491078cd9', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:32:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:32:35 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-a8e9de6d-b7bd-4b66-a378-d69b96e72835 req-8753afda-46c1-4902-b947-e71bf78eae79 tempest-AttachVolumeTestJSON-1136610169 None] attachment_update completed successfully.
Sep 17 07:32:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 0 in 1.696s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:36 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc__tnbzxopdevstack@QuobyteHD, size 112.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:32:36 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Converted 112.00 MB image at 65.55 MB/s
Sep 17 07:32:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 1G" returned: 0 in 0.297s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:36 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b0a8e-cf67-4779-94d0-fd57dd2bfa2c]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 0 in 0.688s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:38 devstack quobyte-client[83654]: System call of process 87472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 1 in 0.614s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Downloaded image f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 2f3a0f71-055b-43ca-9003-70a0a7f91fd5 successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc for user b07811ba9f324d7bb0c0c73c64703e51 is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Marking volume 2f3a0f71-055b-43ca-9003-70a0a7f91fd5 as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Copying metadata from image f78f338c-82d6-4001-a9f8-06473b1187dc to 2f3a0f71-055b-43ca-9003-70a0a7f91fd5. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Creating volume glance metadata for volume 2f3a0f71-055b-43ca-9003-70a0a7f91fd5 backed by image f78f338c-82d6-4001-a9f8-06473b1187dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8e2c9e-eb6d-41a5-a00a-7a48935fc341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c90693640>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694b2fa8-e934-487f-9ee5-90ab9eea5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:38 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Volume volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 (2f3a0f71-055b-43ca-9003-70a0a7f91fd5): created successfully
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694b2fa8-e934-487f-9ee5-90ab9eea5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Flow 'volume_create_manager' (60f74337-2c2b-487d-b584-cff9a29f2b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0066fb9b-3e28-46a5-8c53-ac107daca69f tempest-TaggedBootDevicesTest-1843888513 None] Created volume successfully.
Sep 17 07:32:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Flow 'volume_create_manager' (b15cf573-bf34-4e47-9d9d-1a8de2ed241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5b7fa4-6ef8-4428-8627-e54882b4d975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf5b7fa4-6ef8-4428-8627-e54882b4d975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-310207041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f984c10-fab3-4259-a1f4-7603b1a532b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfdc973f3f6436b85d26d50f37886d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:40Z,use_quota=True,user_id='b07811ba9f324d7bb0c0c73c64703e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa86f6d-aaf5-43a3-b6e7-80840e042dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa86f6d-aaf5-43a3-b6e7-80840e042dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7a7d3b-a0a9-412f-a2c2-881cab66a0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7a7d3b-a0a9-412f-a2c2-881cab66a0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f984c10-fab3-4259-a1f4-7603b1a532b3', 'volume_name': 'volume-3f984c10-fab3-4259-a1f4-7603b1a532b3', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c460d766-24f6-4045-93dc-a7305fa352e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c460d766-24f6-4045-93dc-a7305fa352e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e536abc4-3b8d-4fba-8b3a-614610c8899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:40 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Volume 3f984c10-fab3-4259-a1f4-7603b1a532b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f984c10-fab3-4259-a1f4-7603b1a532b3', 'volume_size': 1}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-310207041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f984c10-fab3-4259-a1f4-7603b1a532b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfdc973f3f6436b85d26d50f37886d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:40Z,use_quota=True,user_id='b07811ba9f324d7bb0c0c73c64703e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Creating volume 3f984c10-fab3-4259-a1f4-7603b1a532b3 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:32:40 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:40 devstack quobyte-client[83654]: System call of process 87798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:32:40 devstack quobyte-client[83654]: System call of process 87798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:32:40 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=11, name=volume-3f984c10-fab3-4259-a1f4-7603b1a532b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 1073741824" returned: 0 in 0.362s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.572s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e536abc4-3b8d-4fba-8b3a-614610c8899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f984c10-fab3-4259-a1f4-7603b1a532b3', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ddb209-799e-44d3-b754-050fc73fb24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:41 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Volume volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 (3f984c10-fab3-4259-a1f4-7603b1a532b3): created successfully
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ddb209-799e-44d3-b754-050fc73fb24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Flow 'volume_create_manager' (b15cf573-bf34-4e47-9d9d-1a8de2ed241d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-47658a53-b4ff-479d-b111-dc739903ec01 tempest-TaggedBootDevicesTest-1843888513 None] Created volume successfully.
Sep 17 07:32:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Flow 'volume_create_manager' (eb08fdca-f87d-4c97-8a1a-0278a29f0883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a3c915-655d-4f41-983b-6fa0c0bd8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a3c915-655d-4f41-983b-6fa0c0bd8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1066262841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cae7f3-9917-4668-b953-0f66cc46231c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfdc973f3f6436b85d26d50f37886d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:43Z,use_quota=True,user_id='b07811ba9f324d7bb0c0c73c64703e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0cb56c-9a27-4085-94f9-8cf56897ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0cb56c-9a27-4085-94f9-8cf56897ee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44617816-eb07-4075-92b4-fdb4d172859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44617816-eb07-4075-92b4-fdb4d172859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78cae7f3-9917-4668-b953-0f66cc46231c', 'volume_name': 'volume-78cae7f3-9917-4668-b953-0f66cc46231c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ee4694-b54c-46be-938c-8b4aba3f0ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ee4694-b54c-46be-938c-8b4aba3f0ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2325dc-3fbb-4f6c-b459-60f742fa5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Volume 78cae7f3-9917-4668-b953-0f66cc46231c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78cae7f3-9917-4668-b953-0f66cc46231c', 'volume_size': 1}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1066262841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78cae7f3-9917-4668-b953-0f66cc46231c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfdc973f3f6436b85d26d50f37886d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:43Z,use_quota=True,user_id='b07811ba9f324d7bb0c0c73c64703e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Creating volume 78cae7f3-9917-4668-b953-0f66cc46231c {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:32:43 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:32:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:44 devstack quobyte-client[83654]: System call of process 87820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:32:44 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=12, name=volume-78cae7f3-9917-4668-b953-0f66cc46231c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:32:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c 1073741824" returned: 0 in 0.724s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.142s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c" returned: 0 in 2.370s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] <== create_volume: return (3298ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.314s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.838s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2325dc-3fbb-4f6c-b459-60f742fa5652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78cae7f3-9917-4668-b953-0f66cc46231c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e57527-7de4-4a95-a4e6-cb8dc61989f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:32:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Volume volume-78cae7f3-9917-4668-b953-0f66cc46231c (78cae7f3-9917-4668-b953-0f66cc46231c): created successfully
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e57527-7de4-4a95-a4e6-cb8dc61989f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:32:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Flow 'volume_create_manager' (eb08fdca-f87d-4c97-8a1a-0278a29f0883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:32:47 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4bf214c8-2284-4e54-bcf6-ae2489217557 tempest-TaggedBootDevicesTest-1843888513 None] Created volume successfully.
Sep 17 07:32:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:32:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:32:54 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6591aad1-fdbc-4ca9-b386-9caddc0a6b45]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:32:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:32:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab" returned: 0 in 0.799s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:32:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:32:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-a776e016-fcce-42c2-9bcc-33627822beab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64489d2c-8825-477c-89d0-c5a18714fafe', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:32:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:32:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-195d1a3c-e81b-4f62-a75b-9b62ea527111 req-864a6b87-75b2-4844-a47d-bf5139efc525 tempest-TaggedAttachmentsTest-1691834373 None] attachment_update completed successfully.
Sep 17 07:33:05 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=19,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:33:05 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=12,cinder:SELECT=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:33:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:33:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:33:23 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c63c12-f493-4abf-a867-a962a5290fc0]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:33:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:33:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 0 in 1.057s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:33:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:33:24 devstack quobyte-client[83654]: System call of process 88495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:33:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 1 in 0.646s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:33:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:33:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:33:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0d2b145-5500-4ef8-962b-834ebd087584', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:33:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:33:25 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-5d8d6846-1810-4611-a835-56a91c6a01c8 tempest-TaggedBootDevicesTest-1843888513 None] attachment_update completed successfully.
Sep 17 07:33:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-b8e32702-1286-4574-b303-57157be862f8 req-7c48a6cf-8708-425c-8338-41547a816a5f tempest-TaggedAttachmentsTest-1691834373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:33:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-b8e32702-1286-4574-b303-57157be862f8 req-7c48a6cf-8708-425c-8338-41547a816a5f tempest-TaggedAttachmentsTest-1691834373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:33:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-b8e32702-1286-4574-b303-57157be862f8 req-7c48a6cf-8708-425c-8338-41547a816a5f tempest-TaggedAttachmentsTest-1691834373 None] Terminate volume connection completed successfully.
Sep 17 07:33:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-b8e32702-1286-4574-b303-57157be862f8 req-7c48a6cf-8708-425c-8338-41547a816a5f tempest-TaggedAttachmentsTest-1691834373 None] Deleting attachment 64489d2c-8825-477c-89d0-c5a18714fafe. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:33:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:33:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.062s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:33:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4ffadb-7e2c-43f2-810e-9f68e649fba4]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:33:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:33:32 devstack quobyte-client[83654]: System call of process 88538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:33:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3" returned: 0 in 1.756s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:33:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.200s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:33:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-3f984c10-fab3-4259-a1f4-7603b1a532b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3756772-73f0-4338-98e1-d024b75d76c0', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:33:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:33:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-47b7b8d2-07e7-4379-bf42-ce08181576dc tempest-TaggedBootDevicesTest-1843888513 None] attachment_update completed successfully.
Sep 17 07:33:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:33:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:33:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44a18f8-540e-48b6-b80e-39f7c40c1901]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:33:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:33:38 devstack quobyte-client[83654]: System call of process 88581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:33:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c" returned: 0 in 0.958s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:33:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:33:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-78cae7f3-9917-4668-b953-0f66cc46231c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06c94c26-c7a8-453e-9cc0-d92a4758783b', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:33:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:33:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-a24b0490-7cc8-41ef-928a-829fbd6cd5c6 req-29755502-7f16-4607-88ad-4a7378e20570 tempest-TaggedBootDevicesTest-1843888513 None] attachment_update completed successfully.
Sep 17 07:33:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.369s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:33:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:33:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:33:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=19,cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:34:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Acquiring lock "cinder-a776e016-fcce-42c2-9bcc-33627822beab-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:34:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Lock "cinder-a776e016-fcce-42c2-9bcc-33627822beab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:34:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:34:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Acquiring lock "cinder-quobyte-a776e016-fcce-42c2-9bcc-33627822beab" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:34:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Lock "cinder-quobyte-a776e016-fcce-42c2-9bcc-33627822beab" acquired by "delete_volume" :: waited 0.041s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:34:24 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b26a04-ab28-402d-9cc3-b57bb05a8252]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:34:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:34:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab" returned: 0 in 0.889s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:34:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:34:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a776e016-fcce-42c2-9bcc-33627822beab" returned: 0 in 0.137s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:34:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Lock "cinder-quobyte-a776e016-fcce-42c2-9bcc-33627822beab" released by "delete_volume" :: held 1.291s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Created reservations ['b0fce4aa-32f8-4f16-ae90-32b028170489', 'f72c8ff4-848c-441c-9350-7540f56f83d7', '25d9d272-a670-4c15-b3e6-4e5f32860fba', '1acfb0a4-5581-4eea-b7aa-6af2a41f7d39'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:34:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.145s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:34:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:34:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Deleted volume successfully.
Sep 17 07:34:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-42b10bcc-e9bd-46a5-b7a5-29a894351556 tempest-TaggedAttachmentsTest-1691834373 None] Lock "cinder-a776e016-fcce-42c2-9bcc-33627822beab-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:34:36 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:34:37 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:34:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-269e57ee-3b91-4788-8c46-ada7cc97cc7f req-f8aa3144-0043-4b98-9441-21078b3076c3 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:34:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-269e57ee-3b91-4788-8c46-ada7cc97cc7f req-f8aa3144-0043-4b98-9441-21078b3076c3 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:34:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-269e57ee-3b91-4788-8c46-ada7cc97cc7f req-f8aa3144-0043-4b98-9441-21078b3076c3 tempest-AttachVolumeTestJSON-1136610169 None] Terminate volume connection completed successfully.
Sep 17 07:34:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-269e57ee-3b91-4788-8c46-ada7cc97cc7f req-f8aa3144-0043-4b98-9441-21078b3076c3 tempest-AttachVolumeTestJSON-1136610169 None] Deleting attachment 6cb03054-f2bc-4ac9-a9b9-329491078cd9. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.139s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.692s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:34:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:34:51 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:34:51 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:35:45 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.312s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:35:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:35:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:36:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-32b584b8-472f-4d5f-88b5-8f0423bcb17a tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-32b584b8-472f-4d5f-88b5-8f0423bcb17a tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:42 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-32b584b8-472f-4d5f-88b5-8f0423bcb17a tempest-TaggedBootDevicesTest-1843888513 None] Terminate volume connection completed successfully.
Sep 17 07:36:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-32b584b8-472f-4d5f-88b5-8f0423bcb17a tempest-TaggedBootDevicesTest-1843888513 None] Deleting attachment f0d2b145-5500-4ef8-962b-834ebd087584. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:36:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-60325b8c-2247-4df3-82dc-29ca66ada0e3 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-60325b8c-2247-4df3-82dc-29ca66ada0e3 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:42 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-60325b8c-2247-4df3-82dc-29ca66ada0e3 tempest-TaggedBootDevicesTest-1843888513 None] Terminate volume connection completed successfully.
Sep 17 07:36:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-60325b8c-2247-4df3-82dc-29ca66ada0e3 tempest-TaggedBootDevicesTest-1843888513 None] Deleting attachment c3756772-73f0-4338-98e1-d024b75d76c0. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:36:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-5397187a-00a2-449c-8dfc-8b1046984642 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-5397187a-00a2-449c-8dfc-8b1046984642 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-5397187a-00a2-449c-8dfc-8b1046984642 tempest-TaggedBootDevicesTest-1843888513 None] Terminate volume connection completed successfully.
Sep 17 07:36:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-3b17dda7-e538-496b-847c-d15be5a6f0d9 req-5397187a-00a2-449c-8dfc-8b1046984642 tempest-TaggedBootDevicesTest-1843888513 None] Deleting attachment 06c94c26-c7a8-453e-9cc0-d92a4758783b. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.151s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:36:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "cinder-78cae7f3-9917-4668-b953-0f66cc46231c-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:36:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-78cae7f3-9917-4668-b953-0f66cc46231c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:36:52 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "cinder-quobyte-78cae7f3-9917-4668-b953-0f66cc46231c" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:36:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-quobyte-78cae7f3-9917-4668-b953-0f66cc46231c" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:36:52 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb7e411-5e10-4762-bbbe-d3339788f083]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:36:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c" returned: 0 in 0.660s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78cae7f3-9917-4668-b953-0f66cc46231c" returned: 0 in 0.295s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-quobyte-78cae7f3-9917-4668-b953-0f66cc46231c" released by "delete_volume" :: held 1.200s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Created reservations ['38c8642e-d7c8-4f9b-a3be-1c3193089f53', '33553ba3-813e-4638-ae85-4fc802abc722', '082f25a1-e978-4e83-a0f8-4de1677e6409', 'bf1760c6-0dcc-4679-92a9-ab7fab048968'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:36:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "cinder-3f984c10-fab3-4259-a1f4-7603b1a532b3-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:36:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.681s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:55 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:36:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-3f984c10-fab3-4259-a1f4-7603b1a532b3-delete_volume" acquired by "delete_volume" :: waited 0.311s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:36:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Deleted volume successfully.
Sep 17 07:36:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3315d732-601c-410e-9e1a-80badc8eb08e tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-78cae7f3-9917-4668-b953-0f66cc46231c-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:36:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:36:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "cinder-quobyte-3f984c10-fab3-4259-a1f4-7603b1a532b3" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:36:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-quobyte-3f984c10-fab3-4259-a1f4-7603b1a532b3" acquired by "delete_volume" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:36:56 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[89556ea3-04cf-45ec-a026-35c2f67f5ef3]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:36:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3" returned: 0 in 0.944s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f984c10-fab3-4259-a1f4-7603b1a532b3" returned: 0 in 0.212s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-quobyte-3f984c10-fab3-4259-a1f4-7603b1a532b3" released by "delete_volume" :: held 1.445s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Created reservations ['e1605677-4f41-4f76-8a5c-8eb68f098699', 'd044d1fc-a2d2-4c56-ad8e-cafc37c2e8db', '0b188901-d053-4022-bb33-8e8107c83958', '807c80ea-00ac-4cc4-80d4-9f638165bb84'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:36:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:36:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.279s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:36:59 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:36:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Deleted volume successfully.
Sep 17 07:36:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ae0ae53b-4d21-456f-86f9-3b62099d1fb3 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-3f984c10-fab3-4259-a1f4-7603b1a532b3-delete_volume" released by "delete_volume" :: held 4.339s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "cinder-2f3a0f71-055b-43ca-9003-70a0a7f91fd5-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-2f3a0f71-055b-43ca-9003-70a0a7f91fd5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:37:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "cinder-quobyte-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-quobyte-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" acquired by "delete_volume" :: waited 0.029s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c45758-c4cd-45f2-841c-538ee068cd8b]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 0 in 0.451s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:01 devstack quobyte-client[83654]: System call of process 90125 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:37:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 1 in 0.908s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:37:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" returned: 0 in 0.150s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-quobyte-2f3a0f71-055b-43ca-9003-70a0a7f91fd5" released by "delete_volume" :: held 1.914s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:37:02 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Created reservations ['1cd79d04-522e-498c-a344-ad0a0d07cb8f', 'a3202d24-06b3-41a2-98b5-35849e21c670', '32705a99-c892-4956-8588-d3594ba06229', 'cd426e02-5dff-4f88-b983-47e76ee6db3d'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.178s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:37:03 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Deleted volume successfully.
Sep 17 07:37:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3782429c-5dbf-417b-a905-1809c9f0fbc6 tempest-TaggedBootDevicesTest-1843888513 None] Lock "cinder-2f3a0f71-055b-43ca-9003-70a0a7f91fd5-delete_volume" released by "delete_volume" :: held 3.630s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:37:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=24,cinder:INSERT=6,cinder:UPDATE=21 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:37:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=12,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:37:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Flow 'volume_create_manager' (f82688e7-4329-4d07-808d-d8b248a44a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dbffa5-3699-45ac-affb-9a270821c309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14dbffa5-3699-45ac-affb-9a270821c309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1144724369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54db526e-ba0c-4fb2-9917-9fed54c25bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf549b0c9efb477fb085fe1a615349e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:17Z,use_quota=True,user_id='5b0b28c23ddb42d3b2edd2af6bd6473d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cc6246-28e6-4230-9a3b-2f39b7a87664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cc6246-28e6-4230-9a3b-2f39b7a87664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e607458-edbe-4022-9cd9-817f6496aafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e607458-edbe-4022-9cd9-817f6496aafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54db526e-ba0c-4fb2-9917-9fed54c25bbe', 'volume_name': 'volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3defa23-b746-45ce-8e2c-540787986dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3defa23-b746-45ce-8e2c-540787986dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd91a813-42f0-47f1-9cd1-19f611c42080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:18 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Volume 54db526e-ba0c-4fb2-9917-9fed54c25bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe', 'volume_size': 1}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1144724369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54db526e-ba0c-4fb2-9917-9fed54c25bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf549b0c9efb477fb085fe1a615349e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:17Z,use_quota=True,user_id='5b0b28c23ddb42d3b2edd2af6bd6473d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Creating volume 54db526e-ba0c-4fb2-9917-9fed54c25bbe {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:37:18 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:37:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=13, name=volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:37:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe 1073741824" returned: 0 in 1.381s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe" returned: 0 in 0.744s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] <== create_volume: return (2421ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:37:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.492s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd91a813-42f0-47f1-9cd1-19f611c42080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ff3fa9-42d4-4fec-a109-1a92212eb9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:21 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Volume volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe (54db526e-ba0c-4fb2-9917-9fed54c25bbe): created successfully
Sep 17 07:37:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ff3fa9-42d4-4fec-a109-1a92212eb9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Flow 'volume_create_manager' (f82688e7-4329-4d07-808d-d8b248a44a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:37:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-965e021d-acf5-47eb-bf7b-2fdfdd5e398c tempest-AttachVolumeShelveTestJSON-134626373 None] Created volume successfully.
Sep 17 07:37:31 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:37:31 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.278s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:37:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-868c9380-43b6-45fd-ad5e-d9ab2270e082 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:37:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-868c9380-43b6-45fd-ad5e-d9ab2270e082 tempest-GroupSnapshotsTest-476325354 None] Group tempest-GroupSnapshotsTest-Group-1602916372: creating
Sep 17 07:37:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-868c9380-43b6-45fd-ad5e-d9ab2270e082 tempest-GroupSnapshotsTest-476325354 None] Group tempest-GroupSnapshotsTest-Group-1602916372: created successfully
Sep 17 07:37:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-868c9380-43b6-45fd-ad5e-d9ab2270e082 tempest-GroupSnapshotsTest-476325354 None] Create group completed successfully.
Sep 17 07:37:52 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (e0e31f12-e1ef-4555-9986-9abbd4e4cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a428311-abb6-4451-926f-c3de1ebd7469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a428311-abb6-4451-926f-c3de1ebd7469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-206346274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=725e5165-f67d-42f5-ba52-4809fccd3091,host='devstack@QuobyteHD#QuobyteHD',id=5eb7190f-f5c7-4bdf-bf19-05efa0e693f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:52Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb0ddc15-977b-4793-8ef4-6738579fd2cd),volume_type_id=bb0ddc15-977b-4793-8ef4-6738579fd2cd)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490bc527-2962-46be-82a9-2c3bcf052674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490bc527-2962-46be-82a9-2c3bcf052674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fc13d7-b766-436c-aabb-3731dcc79155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94fc13d7-b766-436c-aabb-3731dcc79155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb7190f-f5c7-4bdf-bf19-05efa0e693f5', 'volume_name': 'volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2576da-8d45-4998-8c3b-f6892761565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2576da-8d45-4998-8c3b-f6892761565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f266c0-af39-4d1a-83aa-02480adb8326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Volume 5eb7190f-f5c7-4bdf-bf19-05efa0e693f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5', 'volume_size': 1}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=725e5165-f67d-42f5-ba52-4809fccd3091,created_at=2025-09-17T05:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-206346274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=725e5165-f67d-42f5-ba52-4809fccd3091,host='devstack@QuobyteHD#QuobyteHD',id=5eb7190f-f5c7-4bdf-bf19-05efa0e693f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:52Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb0ddc15-977b-4793-8ef4-6738579fd2cd),volume_type_id=bb0ddc15-977b-4793-8ef4-6738579fd2cd)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Creating volume 5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:37:52 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:37:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:53 devstack quobyte-client[83654]: System call of process 90433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:37:53 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=14, name=volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:37:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 1073741824" returned: 0 in 0.577s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 0.134s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] <== create_volume: return (822ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:37:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22f266c0-af39-4d1a-83aa-02480adb8326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a9452b-14c7-403d-a97c-8edfaf03867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:37:54 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Volume volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 (5eb7190f-f5c7-4bdf-bf19-05efa0e693f5): created successfully
Sep 17 07:37:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a9452b-14c7-403d-a97c-8edfaf03867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:37:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (e0e31f12-e1ef-4555-9986-9abbd4e4cb46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:37:54 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-84a85a6d-f19d-4749-be29-017e26d0a2ff tempest-GroupSnapshotsTest-476325354 None] Created volume successfully.
Sep 17 07:37:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] GroupSnapshot 3402468e-3b55-460b-b99e-194740224886: creating.
Sep 17 07:37:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:37:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Group snapshot 3402468e-3b55-460b-b99e-194740224886: creating. {{(pid=83645) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 07:37:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Creating offline snapshot 5f5e2f20-b319-42c4-92a5-cfe71aac3b8a of volume 5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:37:56 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d7ff5f-4131-4058-85a6-7fc2b67d378e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:37:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 0.543s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:56 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=15, name=volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:37:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a 1G" returned: 0 in 0.251s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img rebase -u -b volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.228s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.127s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.info" returned: 0 in 0.167s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.info" returned: 0 in 0.087s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:37:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:37:58 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0ae92de2-1a24-4943-b2de-b06af84ec331 tempest-GroupSnapshotsTest-476325354 None] group_snapshot 3402468e-3b55-460b-b99e-194740224886: created successfully
Sep 17 07:37:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:37:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:37:59 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ee3296-cac2-4d51-ba81-64826e38fb73]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:37:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe" returned: 0 in 0.585s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.682s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9220bd77-991c-4b91-a0dd-3ac0ccd2725f', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:38:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:00 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-bbc5001d-d1da-420e-9358-6d76bcd1147e req-c4627640-7084-443f-9419-7c8a4178370f tempest-AttachVolumeShelveTestJSON-134626373 None] attachment_update completed successfully.
Sep 17 07:38:01 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-5f5e2f20-b319-42c4-92a5-cfe71aac3b8a-3cda686c-4b26-4683-8f89-f55cc487cb82" by "_create_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5f5e2f20-b319-42c4-92a5-cfe71aac3b8a-3cda686c-4b26-4683-8f89-f55cc487cb82" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Creating volume 3cda686c-4b26-4683-8f89-f55cc487cb82 from snapshot 5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-3cda686c-4b26-4683-8f89-f55cc487cb82" by "_copy_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-3cda686c-4b26-4683-8f89-f55cc487cb82" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] snapshot: 5f5e2f20-b319-42c4-92a5-cfe71aac3b8a, volume: 3cda686c-4b26-4683-8f89-f55cc487cb82,  {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ddb49a-3e26-4e4d-bab9-0f08014ef90e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.455s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Creating direct copy from snapshot {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f664a0b-e23b-4ed7-bdee-24007cedcfe5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 0.471s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG cinder.utils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 not found in is_blk_device check {{(pid=83645) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 07:38:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:02 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=17, name=volume-3cda686c-4b26-4683-8f89-f55cc487cb82, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:12 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=6,cinder:SELECT=17 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:38:12 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:38:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82" returned: 0 in 14.011s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[75022c91-733b-4a31-b2cf-301f9b3f517e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 0.904s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:17 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Image conversion details: src /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5, size 1024.00 MB, duration 14.02 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:38:17 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Converted 1024.00 MB image at 73.05 MB/s
Sep 17 07:38:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:38:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82" returned: 0 in 0.265s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-3cda686c-4b26-4683-8f89-f55cc487cb82" released by "_copy_volume_from_snapshot" :: held 16.542s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:38:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5f5e2f20-b319-42c4-92a5-cfe71aac3b8a-3cda686c-4b26-4683-8f89-f55cc487cb82" released by "_create_volume_from_snapshot" :: held 16.594s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:38:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.629s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-080463d7-a150-4314-899a-ea7571b79ef3 tempest-GroupSnapshotsTest-476325354 None] Create group from source-snapshot-3402468e-3b55-460b-b99e-194740224886 completed successfully.
Sep 17 07:38:19 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-3cda686c-4b26-4683-8f89-f55cc487cb82" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:38:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-3cda686c-4b26-4683-8f89-f55cc487cb82" acquired by "delete_volume" :: waited 0.040s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:38:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1190b8b-c1fb-4c7c-b776-4098b76348dc]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82" returned: 0 in 0.519s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3cda686c-4b26-4683-8f89-f55cc487cb82" returned: 0 in 0.119s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-3cda686c-4b26-4683-8f89-f55cc487cb82" released by "delete_volume" :: held 0.842s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Created reservations ['a17561a1-abc7-44dc-8359-9c0e6fc12545'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:38:21 devstack cinder-volume[83645]: WARNING cinder.quota [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1942866045 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1942866045, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:38:21 devstack cinder-volume[83645]: WARNING cinder.quota [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1942866045 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1942866045, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Created reservations ['c7e51c5c-cef6-4cd9-9022-c58ae6803077', 'a3350a6c-7dc4-4d12-9247-5207884cf053', 'd44ab473-d07b-4f84-873b-84b88b5e9ce9', 'b7bce8e6-86ab-4936-b45d-27c007a3d493'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.174s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:21 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:38:22 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d8234382-d078-472d-99c1-2423994809df tempest-GroupSnapshotsTest-476325354 None] Delete group completed successfully.
Sep 17 07:38:22 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] group_snapshot 3402468e-3b55-460b-b99e-194740224886: deleting
Sep 17 07:38:23 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] group_snapshot 3402468e-3b55-460b-b99e-194740224886: deleting {{(pid=83645) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" acquired by "delete_snapshot" :: waited 0.084s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Deleting offline snapshot 5f5e2f20-b319-42c4-92a5-cfe71aac3b8a of volume 5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] snapshot_file for this snap is: volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc001b-8c85-418f-915c-9c5a78431ef7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.778s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:38:24 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[048249df-108b-4a01-b034-6c9e2a400f6f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:24 devstack quobyte-client[83654]: System call of process 90529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 0.670s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.411s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5.5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" returned: 0 in 0.225s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5f5e2f20-b319-42c4-92a5-cfe71aac3b8a" released by "_delete_snapshot" :: held 2.699s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:38:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" released by "delete_snapshot" :: held 2.721s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:38:26 devstack cinder-volume[83645]: WARNING cinder.quota [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1942866045 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1942866045, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:38:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['2938b7fe-3b0b-4517-bd98-034c835a327a', '5d62a5e4-b954-4b9b-85df-1cd525bc9437', '4c8279c0-50c3-4b40-823d-a50a34b5a12f', '4f3eb08a-0d70-4413-be0d-bca8256e8d9c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:38:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-16416cc6-24e9-445d-8950-02c7a293a8a5 tempest-GroupSnapshotsTest-476325354 None] group_snapshot 3402468e-3b55-460b-b99e-194740224886: deleted successfully
Sep 17 07:38:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:38:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" acquired by "delete_volume" :: waited 0.046s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:38:28 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9614293e-c642-4e7f-b175-722b334da216]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:29 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:38:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Flow 'volume_create_manager' (35b03da0-71e2-4655-a85c-e65db3e90e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d87244-c380-47a8-9c13-524e9c241fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 1.069s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d87244-c380-47a8-9c13-524e9c241fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1345850103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b763873-a982-4621-899c-3114aa326b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4971a4ba4d464cd2868cf8f5cfb632de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:28Z,use_quota=True,user_id='07fd72e6b737485ba307ceab7e39f4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290ba845-24ce-4384-ace3-cbb753bc5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (290ba845-24ce-4384-ace3-cbb753bc5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7f4a0a-1796-48f0-bef0-ceb6adf94482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7f4a0a-1796-48f0-bef0-ceb6adf94482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b763873-a982-4621-899c-3114aa326b69', 'volume_name': 'volume-9b763873-a982-4621-899c-3114aa326b69', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a1dbd3-d55f-49ae-9edb-147205fac137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a1dbd3-d55f-49ae-9edb-147205fac137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4460415f-e1aa-4bf7-b203-514b61206b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Volume 9b763873-a982-4621-899c-3114aa326b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b763873-a982-4621-899c-3114aa326b69', 'volume_size': 1}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1345850103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b763873-a982-4621-899c-3114aa326b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4971a4ba4d464cd2868cf8f5cfb632de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:28Z,use_quota=True,user_id='07fd72e6b737485ba307ceab7e39f4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Creating volume 9b763873-a982-4621-899c-3114aa326b69 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:38:30 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:30 devstack quobyte-client[83654]: System call of process 90588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:30 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=18, name=volume-9b763873-a982-4621-899c-3114aa326b69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" returned: 0 in 1.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-5eb7190f-f5c7-4bdf-bf19-05efa0e693f5" released by "delete_volume" :: held 2.385s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:38:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69 1073741824" returned: 0 in 0.943s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69" returned: 0 in 0.642s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] <== create_volume: return (1759ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['44adf5c7-cc0e-4414-a1f8-a47e9da9cdba'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4460415f-e1aa-4bf7-b203-514b61206b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b763873-a982-4621-899c-3114aa326b69', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a1389-b67d-4eb2-bcbc-6893de278acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:32 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Volume volume-9b763873-a982-4621-899c-3114aa326b69 (9b763873-a982-4621-899c-3114aa326b69): created successfully
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26a1389-b67d-4eb2-bcbc-6893de278acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Flow 'volume_create_manager' (35b03da0-71e2-4655-a85c-e65db3e90e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:32 devstack cinder-volume[83645]: WARNING cinder.db.sqlalchemy.api [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1942866045']
Sep 17 07:38:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-55115f51-2694-4e9e-87cd-da9585bcde11 tempest-AttachVolumeTestJSON-1136610169 None] Created volume successfully.
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['a849bc05-1c3d-4cd4-a843-ac821c961763', 'f86d9c97-0478-4750-b792-76344c8b7351', 'eefab2b6-21a4-4e4b-bef4-23d5bcde0765', 'c6fa6e12-6ef0-4748-9616-79ffced2d085'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.246s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:33 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:38:33 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-134e1bad-372c-47b9-87ee-8f9e54321922 tempest-GroupSnapshotsTest-476325354 None] Delete group completed successfully.
Sep 17 07:38:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-913cc8cb-917b-46c1-810d-850d7f1c4a35 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:35 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-913cc8cb-917b-46c1-810d-850d7f1c4a35 tempest-GroupSnapshotsTest-476325354 None] Group tempest-GroupSnapshotsTest-Group-1368428451: creating
Sep 17 07:38:35 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-913cc8cb-917b-46c1-810d-850d7f1c4a35 tempest-GroupSnapshotsTest-476325354 None] Group tempest-GroupSnapshotsTest-Group-1368428451: created successfully
Sep 17 07:38:35 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-913cc8cb-917b-46c1-810d-850d7f1c4a35 tempest-GroupSnapshotsTest-476325354 None] Create group completed successfully.
Sep 17 07:38:36 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (67720030-bf85-450e-8bb8-f6559faca018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508ccc8c-63ac-4295-aebf-c009c3297a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508ccc8c-63ac-4295-aebf-c009c3297a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1377109412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6099b16-fc95-483c-b0f7-724d127ec10f,host='devstack@QuobyteHD#QuobyteHD',id=44dbbfe2-9e1b-4d58-b764-62fb2ca224f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:36Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce2038d3-75d9-4523-b6c6-8edf93f2fb22),volume_type_id=ce2038d3-75d9-4523-b6c6-8edf93f2fb22)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec9df5d-9015-4cac-aed1-bd67ff5e77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec9df5d-9015-4cac-aed1-bd67ff5e77a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c5e64b-6711-4166-8520-609caa85e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c5e64b-6711-4166-8520-609caa85e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44dbbfe2-9e1b-4d58-b764-62fb2ca224f2', 'volume_name': 'volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abf77f0-a470-42e0-8f75-b899a1a49014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4abf77f0-a470-42e0-8f75-b899a1a49014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d31ecd-24ee-495c-8607-ec3757e4f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Volume 44dbbfe2-9e1b-4d58-b764-62fb2ca224f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2', 'volume_size': 1}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b6099b16-fc95-483c-b0f7-724d127ec10f,created_at=2025-09-17T05:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1377109412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6099b16-fc95-483c-b0f7-724d127ec10f,host='devstack@QuobyteHD#QuobyteHD',id=44dbbfe2-9e1b-4d58-b764-62fb2ca224f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:36Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce2038d3-75d9-4523-b6c6-8edf93f2fb22),volume_type_id=ce2038d3-75d9-4523-b6c6-8edf93f2fb22)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Creating volume 44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:38:36 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:38:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:37 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=19, name=volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 1073741824" returned: 0 in 0.592s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" returned: 0 in 0.282s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:38:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d31ecd-24ee-495c-8607-ec3757e4f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06933cf4-c3a9-4b31-8f40-d4f345e21bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:38 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Volume volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 (44dbbfe2-9e1b-4d58-b764-62fb2ca224f2): created successfully
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06933cf4-c3a9-4b31-8f40-d4f345e21bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (67720030-bf85-450e-8bb8-f6559faca018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bd35c2-1998-496f-a9a2-101ad0ccd0b7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-622e8b07-77fa-498c-8da3-73430fefe755 tempest-GroupSnapshotsTest-476325354 None] Created volume successfully.
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69" returned: 0 in 0.668s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.754s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-9b763873-a982-4621-899c-3114aa326b69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a01db43-f564-4b3d-b289-d5ceeb4728af', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:38:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-f00401f3-c995-4ae5-a8e6-426589d6bf19 req-420dcb57-bb23-4168-b827-90964ed38774 tempest-AttachVolumeTestJSON-1136610169 None] attachment_update completed successfully.
Sep 17 07:38:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:39 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (1c462866-c67b-416a-931d-20400b2822e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb1e3a2-fa4b-43b0-a600-3b4a4f3000af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb1e3a2-fa4b-43b0-a600-3b4a4f3000af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-426057085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6099b16-fc95-483c-b0f7-724d127ec10f,host='devstack@QuobyteHD#QuobyteHD',id=51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:40Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce2038d3-75d9-4523-b6c6-8edf93f2fb22),volume_type_id=ce2038d3-75d9-4523-b6c6-8edf93f2fb22)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7aff10-e03b-4609-85c2-202f32b558df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7aff10-e03b-4609-85c2-202f32b558df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9abb2f1-6b0c-4e2c-bf4f-8da1f24118b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9abb2f1-6b0c-4e2c-bf4f-8da1f24118b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6', 'volume_name': 'volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec88c41-5f8f-4218-9378-834d4beda3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec88c41-5f8f-4218-9378-834d4beda3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec5854b-92b8-4b1e-a513-490ec9b0f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:40 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Volume 51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6', 'volume_size': 1}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b6099b16-fc95-483c-b0f7-724d127ec10f,created_at=2025-09-17T05:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-426057085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6099b16-fc95-483c-b0f7-724d127ec10f,host='devstack@QuobyteHD#QuobyteHD',id=51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:40Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce2038d3-75d9-4523-b6c6-8edf93f2fb22),volume_type_id=ce2038d3-75d9-4523-b6c6-8edf93f2fb22)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Creating volume 51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:38:40 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:40 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=20, name=volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 1073741824" returned: 0 in 0.514s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" returned: 0 in 0.186s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] <== create_volume: return (787ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec5854b-92b8-4b1e-a513-490ec9b0f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0853118-dcd0-4d78-b2ba-bbc176656f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:41 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Volume volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 (51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6): created successfully
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0853118-dcd0-4d78-b2ba-bbc176656f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (1c462866-c67b-416a-931d-20400b2822e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-87c4debf-82d1-4768-b6b9-af14069f16cf tempest-GroupSnapshotsTest-476325354 None] Created volume successfully.
Sep 17 07:38:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6295a40f-9dd1-4385-ae44-60710f80da5c tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6295a40f-9dd1-4385-ae44-60710f80da5c tempest-GroupSnapshotsTest-476325354 None] Update group completed successfully.
Sep 17 07:38:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fc785b52-e1da-46b3-a4ce-ad972d5b1a2b tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fc785b52-e1da-46b3-a4ce-ad972d5b1a2b tempest-GroupSnapshotsTest-476325354 None] Update group completed successfully.
Sep 17 07:38:45 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9b42c916-71c8-444b-872b-403a3adf1f7b tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:45 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9b42c916-71c8-444b-872b-403a3adf1f7b tempest-GroupSnapshotsTest-476325354 None] Update group completed successfully.
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.183s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:38:46 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-93bdb39c-ff4d-4d1a-9ab9-5f1a50cfd7cc tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:46 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-93bdb39c-ff4d-4d1a-9ab9-5f1a50cfd7cc tempest-GroupSnapshotsTest-476325354 None] Update group completed successfully.
Sep 17 07:38:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Flow 'volume_create_manager' (f326d4b2-36d5-4790-bfd8-b1f303509644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978b68c2-c50a-45c1-aca6-c8e83bc6bf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978b68c2-c50a-45c1-aca6-c8e83bc6bf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1239495527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283a6a87-1c8a-4091-867a-b70e8f793cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4971a4ba4d464cd2868cf8f5cfb632de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:47Z,use_quota=True,user_id='07fd72e6b737485ba307ceab7e39f4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a2a1d1-782d-4fbe-9b2f-a978552be06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a2a1d1-782d-4fbe-9b2f-a978552be06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d22cf35-cbf9-4ac9-86e6-2116c7704eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d22cf35-cbf9-4ac9-86e6-2116c7704eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283a6a87-1c8a-4091-867a-b70e8f793cdb', 'volume_name': 'volume-283a6a87-1c8a-4091-867a-b70e8f793cdb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a3d7d4-91af-4c93-a045-328c7c4d0071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a3d7d4-91af-4c93-a045-328c7c4d0071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d868bf87-7ca8-459d-8548-b22797fd128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Volume 283a6a87-1c8a-4091-867a-b70e8f793cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283a6a87-1c8a-4091-867a-b70e8f793cdb', 'volume_size': 1}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1239495527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283a6a87-1c8a-4091-867a-b70e8f793cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4971a4ba4d464cd2868cf8f5cfb632de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:38:47Z,use_quota=True,user_id='07fd72e6b737485ba307ceab7e39f4a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Creating volume 283a6a87-1c8a-4091-867a-b70e8f793cdb {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:38:47 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:38:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:48 devstack quobyte-client[83654]: System call of process 91051 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:48 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=21, name=volume-283a6a87-1c8a-4091-867a-b70e8f793cdb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] GroupSnapshot df75a8f2-13fb-40b9-bb6f-742da6ffa147: creating.
Sep 17 07:38:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Group snapshot df75a8f2-13fb-40b9-bb6f-742da6ffa147: creating. {{(pid=83645) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb 1073741824" returned: 0 in 0.744s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb" returned: 0 in 0.124s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] <== create_volume: return (920ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.389s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Creating offline snapshot 2f88d277-b24a-4719-9172-e3a8c5de3566 of volume 51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d868bf87-7ca8-459d-8548-b22797fd128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283a6a87-1c8a-4091-867a-b70e8f793cdb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d79d2c-588e-433b-92ea-e909994393ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba95509-bd61-47ae-a3a6-bc07b58193ee]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:49 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Volume volume-283a6a87-1c8a-4091-867a-b70e8f793cdb (283a6a87-1c8a-4091-867a-b70e8f793cdb): created successfully
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d79d2c-588e-433b-92ea-e909994393ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:38:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Flow 'volume_create_manager' (f326d4b2-36d5-4790-bfd8-b1f303509644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:38:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-025df384-e677-4bf3-8eca-32bab0b6e383 tempest-AttachVolumeTestJSON-1136610169 None] Created volume successfully.
Sep 17 07:38:50 devstack quobyte-client[83654]: System call of process 91063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" returned: 0 in 1.478s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:51 devstack quobyte-client[83654]: System call of process 91093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:51 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=22, name=volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 1G" returned: 0 in 1.027s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img rebase -u -b volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566" returned: 0 in 0.314s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566" returned: 0 in 0.184s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:38:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566" returned: 0 in 0.357s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.info" returned: 0 in 0.140s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.info" returned: 0 in 0.205s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.688s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Creating offline snapshot a1fece53-53b4-4daf-b664-0b2a72395a09 of volume 44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:38:54 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef0ac0-7910-439b-a9f5-ee1db161b780]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:55 devstack quobyte-client[83654]: System call of process 91142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:38:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" returned: 0 in 1.203s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:56 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=24, name=volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:38:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 1G" returned: 0 in 0.674s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:56 devstack quobyte-client[83654]: System call of process 91159 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:38:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img rebase -u -b volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09" returned: 0 in 0.289s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:56 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:38:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09" returned: 0 in 0.114s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.info" returned: 0 in 0.109s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.info" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.814s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.906s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc21465-6f01-49d9-b115-4c089604e06e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:38:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:38:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb" returned: 0 in 1.017s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:38:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.353s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:38:59 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-283a6a87-1c8a-4091-867a-b70e8f793cdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb97450f-33cb-48c5-93a5-14c04ed8f98f', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:38:59 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:38:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-249a5166-fdd1-44fc-8e17-254ec816b7a5 tempest-GroupSnapshotsTest-476325354 None] group_snapshot df75a8f2-13fb-40b9-bb6f-742da6ffa147: created successfully
Sep 17 07:38:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] group_snapshot df75a8f2-13fb-40b9-bb6f-742da6ffa147: deleting
Sep 17 07:39:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] group_snapshot df75a8f2-13fb-40b9-bb6f-742da6ffa147: deleting {{(pid=83645) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 07:39:00 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-b7e73806-37a4-4cee-b083-2cd3192b3f90 req-8748c248-dc76-4d75-90d0-dc7b4fcbbe56 tempest-AttachVolumeTestJSON-1136610169 None] attachment_update completed successfully.
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" acquired by "delete_snapshot" :: waited 0.085s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-2f88d277-b24a-4719-9172-e3a8c5de3566" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-2f88d277-b24a-4719-9172-e3a8c5de3566" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Deleting offline snapshot 2f88d277-b24a-4719-9172-e3a8c5de3566 of volume 51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] snapshot_file for this snap is: volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a430dece-b455-4323-90d0-5af5eba7544f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566" returned: 0 in 1.322s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:39:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[35355fd3-c6d5-43a8-8976-60410054dc41]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:02 devstack quobyte-client[83654]: System call of process 91214 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" returned: 0 in 0.732s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566" returned: 0 in 0.370s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6.2f88d277-b24a-4719-9172-e3a8c5de3566" returned: 0 in 0.129s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-2f88d277-b24a-4719-9172-e3a8c5de3566" released by "_delete_snapshot" :: held 3.064s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" released by "delete_snapshot" :: held 3.093s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-a1fece53-53b4-4daf-b664-0b2a72395a09" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-a1fece53-53b4-4daf-b664-0b2a72395a09" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Deleting offline snapshot a1fece53-53b4-4daf-b664-0b2a72395a09 of volume 44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] snapshot_file for this snap is: volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fec689-54c6-4004-af41-8992f4ab97a0]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:04 devstack quobyte-client[83654]: System call of process 91230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09" returned: 0 in 0.768s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:39:04 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ca2bd-a751-427c-a9c0-161de59aaeb9]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" returned: 0 in 0.549s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09" returned: 0 in 0.381s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2.a1fece53-53b4-4daf-b664-0b2a72395a09" returned: 0 in 0.216s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-a1fece53-53b4-4daf-b664-0b2a72395a09" released by "_delete_snapshot" :: held 2.523s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" released by "delete_snapshot" :: held 2.560s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:06 devstack cinder-volume[83645]: WARNING cinder.quota [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-453480310 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-453480310, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:06 devstack cinder-volume[83645]: WARNING cinder.quota [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-453480310 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-453480310, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:07 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['9260deac-5f83-4541-8cda-d7bbac07c5ca', '926fbd00-2b7a-4603-ac2f-a62ac69c6763', 'f8328248-b0b2-4eca-b0ef-01cdfa849ab3', '88705d65-62b4-420d-8df5-8cae29a50b9f'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:07 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['0463dccd-b88a-418e-bd90-786a36bebbe0', 'd12c75aa-46dc-4094-8696-b977e97cf6c2', '3005beae-849a-4138-82e1-097616d804bf', 'b2442429-6381-4aaa-909d-5f34daad766d'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:07 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9a25a1b7-32ef-4df6-802d-ce93d0fbc890 tempest-GroupSnapshotsTest-476325354 None] group_snapshot df75a8f2-13fb-40b9-bb6f-742da6ffa147: deleted successfully
Sep 17 07:39:08 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" acquired by "delete_volume" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:08 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b8269a-b420-41fe-a100-7495afce1891]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" returned: 0 in 0.475s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" returned: 0 in 0.101s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-44dbbfe2-9e1b-4d58-b764-62fb2ca224f2" released by "delete_volume" :: held 0.760s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" acquired by "delete_volume" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6132cb42-2517-488e-869e-55fa46afbebc]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:10 devstack quobyte-client[83654]: System call of process 91248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" returned: 0 in 0.667s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" returned: 0 in 0.141s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-51c0a30e-b6ab-41f2-a087-a6ff7e45bfa6" released by "delete_volume" :: held 1.015s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['fa9f7113-1c88-4f9e-819c-8b7158836fac'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:11 devstack cinder-volume[83645]: WARNING cinder.quota [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-453480310 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-453480310, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['ae5a69ac-8115-4b7c-81eb-a639a732c331', '1cfeedf7-afef-4bd8-a1fb-51a28977d17e', '5623550b-728a-4a5c-a89d-47339a4b8c97', '89d3d42b-e435-49fc-a8ef-bf969848533c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['90d27b95-09da-4c96-bc22-0655021d9fed', 'add5c716-e887-4bca-857d-d5c05cc09fe4', 'a1066802-1cdd-4182-9a21-a693da350716', '6354bc56-8d4c-471d-b4dd-12d7eb5fc51b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.136s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:11 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:39:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-87530e26-f9b5-4dd8-a0ab-10e37d3fb261 tempest-GroupSnapshotsTest-476325354 None] Delete group completed successfully.
Sep 17 07:39:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=83,cinder:UPDATE=57,cinder:INSERT=23,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:39:13 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ce37cdf0-0a3e-4089-8995-021f010762bf tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ce37cdf0-0a3e-4089-8995-021f010762bf tempest-GroupSnapshotsTest-476325354 None] Group tempest-GroupSnapshotsTest-Group-949739778: creating
Sep 17 07:39:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=99,cinder:SELECT=87,cinder:INSERT=8,cinder:DELETE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:39:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ce37cdf0-0a3e-4089-8995-021f010762bf tempest-GroupSnapshotsTest-476325354 None] Group tempest-GroupSnapshotsTest-Group-949739778: created successfully
Sep 17 07:39:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ce37cdf0-0a3e-4089-8995-021f010762bf tempest-GroupSnapshotsTest-476325354 None] Create group completed successfully.
Sep 17 07:39:14 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (658fd897-fe39-46bc-aa8f-7691f5af7454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb24e33-cdac-4468-bfdf-a511cf92976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb24e33-cdac-4468-bfdf-a511cf92976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512332732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=70154320-00cb-4757-9167-5242d8537b34,host='devstack@QuobyteHD#QuobyteHD',id=29e2f2a6-fc93-469c-a2b5-c0012d7882c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:14Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91c8ecb3-770f-458e-88b9-006cbd7ea089),volume_type_id=91c8ecb3-770f-458e-88b9-006cbd7ea089)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46451343-152e-4cc4-95c5-74aff10d41fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46451343-152e-4cc4-95c5-74aff10d41fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a8025-deaf-4852-adbf-556e9ae9f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39a8025-deaf-4852-adbf-556e9ae9f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29e2f2a6-fc93-469c-a2b5-c0012d7882c9', 'volume_name': 'volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dfd1ed-873c-4b65-86fa-5769abf7779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dfd1ed-873c-4b65-86fa-5769abf7779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65914967-388a-4b0f-96e2-42f61d9cb9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:14 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Volume 29e2f2a6-fc93-469c-a2b5-c0012d7882c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9', 'volume_size': 1}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=70154320-00cb-4757-9167-5242d8537b34,created_at=2025-09-17T05:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512332732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=70154320-00cb-4757-9167-5242d8537b34,host='devstack@QuobyteHD#QuobyteHD',id=29e2f2a6-fc93-469c-a2b5-c0012d7882c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fba5e1208240c8925aa5ba5f7466de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:14Z,use_quota=True,user_id='00916dccfd2b44008f2ce9e3eae53985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91c8ecb3-770f-458e-88b9-006cbd7ea089),volume_type_id=91c8ecb3-770f-458e-88b9-006cbd7ea089)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Creating volume 29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:39:14 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:39:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:14 devstack quobyte-client[83654]: System call of process 91257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:14 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=26, name=volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 1073741824" returned: 0 in 0.521s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65914967-388a-4b0f-96e2-42f61d9cb9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267c55ed-c056-44eb-89d0-be3753c2c19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:15 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Volume volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 (29e2f2a6-fc93-469c-a2b5-c0012d7882c9): created successfully
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267c55ed-c056-44eb-89d0-be3753c2c19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Flow 'volume_create_manager' (658fd897-fe39-46bc-aa8f-7691f5af7454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d82f1899-11cb-409d-bbd3-10f2e2b6c71f tempest-GroupSnapshotsTest-476325354 None] Created volume successfully.
Sep 17 07:39:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] GroupSnapshot 80660feb-e7cb-4e4f-a5d2-192d227c3edd: creating.
Sep 17 07:39:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Group snapshot 80660feb-e7cb-4e4f-a5d2-192d227c3edd: creating. {{(pid=83645) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 07:39:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Creating offline snapshot 583338bd-a945-408d-b0fe-970a741b3745 of volume 29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:39:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03154ca-4df8-4e25-b69e-7140acdacfeb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" returned: 0 in 0.498s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:18 devstack quobyte-client[83654]: System call of process 91266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=27, name=volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 1G" returned: 0 in 0.792s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img rebase -u -b volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745" returned: 0 in 0.261s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745" returned: 0 in 0.107s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745" returned: 0 in 0.142s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.info" returned: 0 in 0.105s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.info" returned: 0 in 0.139s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:20 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f3cfc1cb-a9b5-4985-9d5e-3d2d99b58f03 tempest-GroupSnapshotsTest-476325354 None] group_snapshot 80660feb-e7cb-4e4f-a5d2-192d227c3edd: created successfully
Sep 17 07:39:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] group_snapshot 80660feb-e7cb-4e4f-a5d2-192d227c3edd: deleting
Sep 17 07:39:21 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] group_snapshot 80660feb-e7cb-4e4f-a5d2-192d227c3edd: deleting {{(pid=83645) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-583338bd-a945-408d-b0fe-970a741b3745" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-583338bd-a945-408d-b0fe-970a741b3745" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Deleting offline snapshot 583338bd-a945-408d-b0fe-970a741b3745 of volume 29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] snapshot_file for this snap is: volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d12f1-1525-4f24-8d20-c241da5cb713]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:22 devstack quobyte-client[83654]: System call of process 91282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745" returned: 0 in 0.630s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:39:22 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[480aa6ef-cec6-43d4-8ca8-e18d12f6b2b6]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" returned: 0 in 0.477s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745" returned: 0 in 0.226s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9.583338bd-a945-408d-b0fe-970a741b3745" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-583338bd-a945-408d-b0fe-970a741b3745" released by "_delete_snapshot" :: held 1.866s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" released by "delete_snapshot" :: held 1.907s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:23 devstack cinder-volume[83645]: WARNING cinder.quota [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1017596896 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1017596896, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:23 devstack cinder-volume[83645]: WARNING cinder.quota [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1017596896 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1017596896, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:23 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] Created reservations ['37d4f0d8-d21a-4da2-bb1f-17f7887c98f0', '88a7c1b8-a6cc-405e-929d-e048ef3b0376', '541d0f6f-9e4c-4455-8f3f-44e093eebcad', '5dfdf053-35f6-4b9c-a423-c88b9bd5dd72'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:23 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c3ae5d7b-fdf6-4080-8e72-02dce871ee2c tempest-GroupSnapshotsTest-476325354 None] group_snapshot 80660feb-e7cb-4e4f-a5d2-192d227c3edd: deleted successfully
Sep 17 07:39:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "cinder-quobyte-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" acquired by "delete_volume" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c18445-67bb-412c-ae58-c5012c7dc5fe]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:25 devstack quobyte-client[83654]: System call of process 91293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" returned: 0 in 0.588s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" returned: 0 in 0.105s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Lock "cinder-quobyte-29e2f2a6-fc93-469c-a2b5-c0012d7882c9" released by "delete_volume" :: held 0.937s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['9719ea87-577d-480e-9d06-f07515062daa'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:26 devstack cinder-volume[83645]: WARNING cinder.quota [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1017596896 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1017596896, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Created reservations ['86d4253f-4f56-40a1-aef5-0f233c93f9ab', '33f5c080-e88c-4d36-a68e-094eff099116', '946eefd6-06ad-44a6-bd47-dd7afd1afe43', '6a04544d-4a84-41e1-9ef4-6226fb7ff0cf'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.121s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:39:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-64d84275-7d02-41d1-81e7-a99dbf585796 tempest-GroupSnapshotsTest-476325354 None] Delete group completed successfully.
Sep 17 07:39:31 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-303500f2-3735-4b65-b05b-6cfafc662c11 req-6fbe4df4-47b0-4431-a6c4-06a24d468d65 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:31 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-303500f2-3735-4b65-b05b-6cfafc662c11 req-6fbe4df4-47b0-4431-a6c4-06a24d468d65 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-303500f2-3735-4b65-b05b-6cfafc662c11 req-6fbe4df4-47b0-4431-a6c4-06a24d468d65 tempest-AttachVolumeTestJSON-1136610169 None] Terminate volume connection completed successfully.
Sep 17 07:39:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-303500f2-3735-4b65-b05b-6cfafc662c11 req-6fbe4df4-47b0-4431-a6c4-06a24d468d65 tempest-AttachVolumeTestJSON-1136610169 None] Deleting attachment 8a01db43-f564-4b3d-b289-d5ceeb4728af. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:39:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ba776217-dff3-43be-a5df-175f3325b748 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:40 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ba776217-dff3-43be-a5df-175f3325b748 tempest-GroupsTest-1193939234 None] Group tempest-Group1-750524881: creating
Sep 17 07:39:40 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ba776217-dff3-43be-a5df-175f3325b748 tempest-GroupsTest-1193939234 None] Group tempest-Group1-750524881: created successfully
Sep 17 07:39:40 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ba776217-dff3-43be-a5df-175f3325b748 tempest-GroupsTest-1193939234 None] Create group completed successfully.
Sep 17 07:39:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3c7053aa-7532-4643-a9b1-0bd0bffe0ded tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3c7053aa-7532-4643-a9b1-0bd0bffe0ded tempest-GroupsTest-1193939234 None] Group tempest-Group2-1094204797: creating
Sep 17 07:39:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3c7053aa-7532-4643-a9b1-0bd0bffe0ded tempest-GroupsTest-1193939234 None] Group tempest-Group2-1094204797: created successfully
Sep 17 07:39:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3c7053aa-7532-4643-a9b1-0bd0bffe0ded tempest-GroupsTest-1193939234 None] Create group completed successfully.
Sep 17 07:39:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Flow 'volume_create_manager' (30f07c6c-0783-4736-9605-e120d32b316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1a781-c092-4b55-a4dd-4a66f4945954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a1a781-c092-4b55-a4dd-4a66f4945954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1552148095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c63138c-7dd1-4526-ae52-addde86a367c,host='devstack@QuobyteHD#QuobyteHD',id=ef973a09-359a-45f4-bf77-0dd13327c779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd6099138684cd09c1a002ea853d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:43Z,use_quota=True,user_id='3c7b9040d18b47a488b7358d8b91149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cc8b7b2-8ca2-412a-ace8-7e4c7d5aa805),volume_type_id=6cc8b7b2-8ca2-412a-ace8-7e4c7d5aa805)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9304a8c-6f4d-427b-828d-bd4143e4957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9304a8c-6f4d-427b-828d-bd4143e4957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824ed45c-abee-457d-a16d-8df92a3ed5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (824ed45c-abee-457d-a16d-8df92a3ed5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef973a09-359a-45f4-bf77-0dd13327c779', 'volume_name': 'volume-ef973a09-359a-45f4-bf77-0dd13327c779', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5c62ad-93cb-4240-9571-1f107c54d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5c62ad-93cb-4240-9571-1f107c54d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9078d7-91df-49fe-8189-1a8ccc562297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Volume ef973a09-359a-45f4-bf77-0dd13327c779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef973a09-359a-45f4-bf77-0dd13327c779', 'volume_size': 1}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3c63138c-7dd1-4526-ae52-addde86a367c,created_at=2025-09-17T05:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1552148095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3c63138c-7dd1-4526-ae52-addde86a367c,host='devstack@QuobyteHD#QuobyteHD',id=ef973a09-359a-45f4-bf77-0dd13327c779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd6099138684cd09c1a002ea853d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:43Z,use_quota=True,user_id='3c7b9040d18b47a488b7358d8b91149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cc8b7b2-8ca2-412a-ace8-7e4c7d5aa805),volume_type_id=6cc8b7b2-8ca2-412a-ace8-7e4c7d5aa805)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Creating volume ef973a09-359a-45f4-bf77-0dd13327c779 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:39:43 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:39:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:43 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=29, name=volume-ef973a09-359a-45f4-bf77-0dd13327c779, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779 1073741824" returned: 0 in 0.671s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779" returned: 0 in 0.168s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] <== create_volume: return (919ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9078d7-91df-49fe-8189-1a8ccc562297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef973a09-359a-45f4-bf77-0dd13327c779', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa0e4f-7ecc-42f8-8150-e89fa144a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:44 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Volume volume-ef973a09-359a-45f4-bf77-0dd13327c779 (ef973a09-359a-45f4-bf77-0dd13327c779): created successfully
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa0e4f-7ecc-42f8-8150-e89fa144a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Flow 'volume_create_manager' (30f07c6c-0783-4736-9605-e120d32b316c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8a88abb3-34db-450e-b01f-b4d07c1400f2 tempest-GroupsTest-1193939234 None] Created volume successfully.
Sep 17 07:39:45 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Acquiring lock "cinder-quobyte-ef973a09-359a-45f4-bf77-0dd13327c779" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:39:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Lock "cinder-quobyte-ef973a09-359a-45f4-bf77-0dd13327c779" acquired by "delete_volume" :: waited 0.054s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7cb5b5-538a-4cd8-8383-45650e17a811]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.349s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:39:46 devstack quobyte-client[83654]: System call of process 91370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779" returned: 0 in 0.547s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef973a09-359a-45f4-bf77-0dd13327c779" returned: 0 in 0.098s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Lock "cinder-quobyte-ef973a09-359a-45f4-bf77-0dd13327c779" released by "delete_volume" :: held 1.063s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Created reservations ['87e54292-01a6-4fc6-9dfb-1bdd6346d151'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:47 devstack cinder-volume[83645]: WARNING cinder.quota [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-371491055 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-371491055, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:47 devstack cinder-volume[83645]: WARNING cinder.quota [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-371491055 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-371491055, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Created reservations ['44fbda27-ea2e-4276-89a1-0400d42ab4fe', 'b4288a75-795d-4b6e-8350-5265d8f0c346', '5fac76fb-7cda-4257-a8f6-6b4417d7f99e', '798bea01-36fa-4e84-8ff8-6774a9d26921'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:47 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:39:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-421780f3-382a-4971-a00d-14739c21c505 tempest-GroupsTest-1193939234 None] Delete group completed successfully.
Sep 17 07:39:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Created reservations ['f32261af-1d4a-4a56-a893-0e0ebbd05153'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.148s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:49 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:39:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d7413daf-7e59-4b17-9429-0ce5f7f40f1b tempest-GroupsTest-1193939234 None] Delete group completed successfully.
Sep 17 07:39:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0a53dd2f-6f4a-49f0-89fa-b8c649e5f100 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0a53dd2f-6f4a-49f0-89fa-b8c649e5f100 tempest-GroupsTest-1193939234 None] Group tempest-GroupsTest-Group-1291406837: creating
Sep 17 07:39:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0a53dd2f-6f4a-49f0-89fa-b8c649e5f100 tempest-GroupsTest-1193939234 None] Group tempest-GroupsTest-Group-1291406837: created successfully
Sep 17 07:39:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0a53dd2f-6f4a-49f0-89fa-b8c649e5f100 tempest-GroupsTest-1193939234 None] Create group completed successfully.
Sep 17 07:39:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:51 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Flow 'volume_create_manager' (875d8d20-c19d-47c1-b6ff-167e6984b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f956e3-669d-4040-99dd-b0a5ada06efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46f956e3-669d-4040-99dd-b0a5ada06efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890203737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c4d84083-60c6-4949-bbab-13e9b613646a,host='devstack@QuobyteHD#QuobyteHD',id=ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd6099138684cd09c1a002ea853d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:52Z,use_quota=True,user_id='3c7b9040d18b47a488b7358d8b91149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee59454e-d5a5-4e74-8fcc-f106acb3da03),volume_type_id=ee59454e-d5a5-4e74-8fcc-f106acb3da03)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c0e4ca-6f13-4cbc-b27f-6a29ff49e2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c0e4ca-6f13-4cbc-b27f-6a29ff49e2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9755a31a-96fa-4d53-8c1b-780d61519208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9755a31a-96fa-4d53-8c1b-780d61519208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f', 'volume_name': 'volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641da3cb-34b7-4668-8658-8512e96dbff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641da3cb-34b7-4668-8658-8512e96dbff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9f61e6-b706-4fdc-bba4-5964f9d95d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Volume ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f', 'volume_size': 1}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c4d84083-60c6-4949-bbab-13e9b613646a,created_at=2025-09-17T05:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1890203737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c4d84083-60c6-4949-bbab-13e9b613646a,host='devstack@QuobyteHD#QuobyteHD',id=ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd6099138684cd09c1a002ea853d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:52Z,use_quota=True,user_id='3c7b9040d18b47a488b7358d8b91149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee59454e-d5a5-4e74-8fcc-f106acb3da03),volume_type_id=ee59454e-d5a5-4e74-8fcc-f106acb3da03)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Creating volume ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:39:52 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:52 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=30, name=volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f 1073741824" returned: 0 in 0.406s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f" returned: 0 in 0.155s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] <== create_volume: return (633ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:39:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9f61e6-b706-4fdc-bba4-5964f9d95d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07d8377-bba8-415f-b524-309b197deb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:53 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Volume volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f (ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f): created successfully
Sep 17 07:39:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07d8377-bba8-415f-b524-309b197deb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Flow 'volume_create_manager' (875d8d20-c19d-47c1-b6ff-167e6984b167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e0fe447f-a9d6-42cc-89bf-f3fa3fb1ad8c tempest-GroupsTest-1193939234 None] Created volume successfully.
Sep 17 07:39:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Flow 'volume_create_manager' (cb38cd57-1383-47f1-a224-d55d8e61677f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3fa45e-b246-4b01-880d-d8510d74b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3fa45e-b246-4b01-880d-d8510d74b117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1864581844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c4d84083-60c6-4949-bbab-13e9b613646a,host='devstack@QuobyteHD#QuobyteHD',id=5abe027e-9a40-4e0c-adb0-26ee5f59cf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd6099138684cd09c1a002ea853d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:55Z,use_quota=True,user_id='3c7b9040d18b47a488b7358d8b91149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee59454e-d5a5-4e74-8fcc-f106acb3da03),volume_type_id=ee59454e-d5a5-4e74-8fcc-f106acb3da03)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e2021-3231-4f2f-a091-c88021ccac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97e2021-3231-4f2f-a091-c88021ccac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7a0b7a-2947-4de7-8d42-1fc9d9459fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7a0b7a-2947-4de7-8d42-1fc9d9459fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5abe027e-9a40-4e0c-adb0-26ee5f59cf24', 'volume_name': 'volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec69e17-74bf-4701-b0f8-fc0fa310deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec69e17-74bf-4701-b0f8-fc0fa310deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7050d89-709f-4f90-9567-b93b97c72ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:55 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Volume 5abe027e-9a40-4e0c-adb0-26ee5f59cf24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24', 'volume_size': 1}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c4d84083-60c6-4949-bbab-13e9b613646a,created_at=2025-09-17T05:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1864581844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c4d84083-60c6-4949-bbab-13e9b613646a,host='devstack@QuobyteHD#QuobyteHD',id=5abe027e-9a40-4e0c-adb0-26ee5f59cf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd6099138684cd09c1a002ea853d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:39:55Z,use_quota=True,user_id='3c7b9040d18b47a488b7358d8b91149b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee59454e-d5a5-4e74-8fcc-f106acb3da03),volume_type_id=ee59454e-d5a5-4e74-8fcc-f106acb3da03)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Creating volume 5abe027e-9a40-4e0c-adb0-26ee5f59cf24 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:39:55 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:55 devstack quobyte-client[83654]: System call of process 91404 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:39:55 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=31, name=volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24 1073741824" returned: 0 in 0.559s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24" returned: 0 in 0.257s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] <== create_volume: return (976ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:39:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3bf10e85-009a-4c7c-85f5-20fe0b5a149e req-12a1fa24-4b5e-4ba3-bb19-b3074846fb08 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7050d89-709f-4f90-9567-b93b97c72ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00212fa9-de02-4c5f-a10c-ac042c0ea2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:39:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3bf10e85-009a-4c7c-85f5-20fe0b5a149e req-12a1fa24-4b5e-4ba3-bb19-b3074846fb08 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:56 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-3bf10e85-009a-4c7c-85f5-20fe0b5a149e req-12a1fa24-4b5e-4ba3-bb19-b3074846fb08 tempest-AttachVolumeTestJSON-1136610169 None] Terminate volume connection completed successfully.
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-3bf10e85-009a-4c7c-85f5-20fe0b5a149e req-12a1fa24-4b5e-4ba3-bb19-b3074846fb08 tempest-AttachVolumeTestJSON-1136610169 None] Deleting attachment bb97450f-33cb-48c5-93a5-14c04ed8f98f. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:39:56 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Volume volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24 (5abe027e-9a40-4e0c-adb0-26ee5f59cf24): created successfully
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00212fa9-de02-4c5f-a10c-ac042c0ea2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:39:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Flow 'volume_create_manager' (cb38cd57-1383-47f1-a224-d55d8e61677f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:39:56 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3bbd03fc-baec-4929-8c88-764ff319168c tempest-GroupsTest-1193939234 None] Created volume successfully.
Sep 17 07:39:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2146bb63-5465-4c2b-a260-ee640808da46 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:57 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2146bb63-5465-4c2b-a260-ee640808da46 tempest-GroupsTest-1193939234 None] Update group completed successfully.
Sep 17 07:39:59 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-29dc4e8b-1c36-4d78-ae01-926ad458c510 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:39:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-29dc4e8b-1c36-4d78-ae01-926ad458c510 tempest-GroupsTest-1193939234 None] Update group completed successfully.
Sep 17 07:40:01 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Acquiring lock "cinder-quobyte-5abe027e-9a40-4e0c-adb0-26ee5f59cf24" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Lock "cinder-quobyte-5abe027e-9a40-4e0c-adb0-26ee5f59cf24" acquired by "delete_volume" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4623431-398d-430a-ad14-a40cc54390a0]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24" returned: 0 in 0.483s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5abe027e-9a40-4e0c-adb0-26ee5f59cf24" returned: 0 in 0.079s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Lock "cinder-quobyte-5abe027e-9a40-4e0c-adb0-26ee5f59cf24" released by "delete_volume" :: held 0.754s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Acquiring lock "cinder-quobyte-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Lock "cinder-quobyte-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f" acquired by "delete_volume" :: waited 0.029s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0aeaf1-774f-462c-a0a2-97e810c2d96a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f" returned: 0 in 0.566s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f" returned: 0 in 0.104s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Lock "cinder-quobyte-ddf6e6ed-e5c7-4b9b-a5dd-5142c41df26f" released by "delete_volume" :: held 0.843s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:04 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Created reservations ['d5117cc3-273b-472b-b1b2-fc3bada709a1'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:04 devstack cinder-volume[83645]: WARNING cinder.quota [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1529245485 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1529245485, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:40:04 devstack cinder-volume[83645]: WARNING cinder.quota [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1529245485 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1529245485, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:40:04 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Created reservations ['69104995-13d5-4e77-b966-b5937387ec3c', 'be645e88-12fa-4c71-bdb3-78c315b96b81', 'd03cba93-a1cd-43cc-b6a2-ab3dcd63d1e1', 'c1a6e58b-f349-4911-bebd-44039267490c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:04 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Created reservations ['1b9868c8-249c-49ab-8ed0-ff316e3a4a38', 'fb7ff933-dcc1-42e5-a261-d62bff67b5aa', '2badd42a-3489-409c-8cf0-376c88fe2ae5', 'c346915a-11da-4c63-ae77-1f89c50213bf'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.172s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:05 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-31b6deab-6963-49a0-a50b-e40761e75d13 tempest-GroupsTest-1193939234 None] Delete group completed successfully.
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "cinder-283a6a87-1c8a-4091-867a-b70e8f793cdb-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-283a6a87-1c8a-4091-867a-b70e8f793cdb-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "cinder-quobyte-283a6a87-1c8a-4091-867a-b70e8f793cdb" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-quobyte-283a6a87-1c8a-4091-867a-b70e8f793cdb" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e77a4e-7034-4b3b-b775-afffaba0d179]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb" returned: 0 in 0.497s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-283a6a87-1c8a-4091-867a-b70e8f793cdb" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-quobyte-283a6a87-1c8a-4091-867a-b70e8f793cdb" released by "delete_volume" :: held 0.775s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Created reservations ['87ba94ce-8d54-4512-8b8b-313e45f0ff88', '04851511-5951-4fb8-a1ce-2d2fe2d18c39', 'dc024090-a415-45fd-aa2a-d7b323cc4d7a', 'd8d45355-f603-456c-b8d5-012cfddd66ad'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:11 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Deleted volume successfully.
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ea016a41-0218-4e48-979f-f96c88da9832 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-283a6a87-1c8a-4091-867a-b70e8f793cdb-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "cinder-9b763873-a982-4621-899c-3114aa326b69-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-9b763873-a982-4621-899c-3114aa326b69-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "cinder-quobyte-9b763873-a982-4621-899c-3114aa326b69" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-quobyte-9b763873-a982-4621-899c-3114aa326b69" acquired by "delete_volume" :: waited 0.020s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c86726-42e9-401f-8a25-09a213509393]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:13 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-4967a14c-d482-4d9d-b17b-000668d0a7bc tempest-GroupsV320Test-559925104 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4967a14c-d482-4d9d-b17b-000668d0a7bc tempest-GroupsV320Test-559925104 None] Group tempest-GroupsV320Test-Group-389435353: creating
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=80,cinder:SELECT=77,cinder:DELETE=3,cinder:INSERT=16 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=68,cinder:SELECT=67,cinder:INSERT=12,cinder:DELETE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:40:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4967a14c-d482-4d9d-b17b-000668d0a7bc tempest-GroupsV320Test-559925104 None] Group tempest-GroupsV320Test-Group-389435353: created successfully
Sep 17 07:40:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4967a14c-d482-4d9d-b17b-000668d0a7bc tempest-GroupsV320Test-559925104 None] Create group completed successfully.
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69" returned: 0 in 0.591s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9b763873-a982-4621-899c-3114aa326b69" returned: 0 in 0.162s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-quobyte-9b763873-a982-4621-899c-3114aa326b69" released by "delete_volume" :: held 0.888s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Created reservations ['2c73957a-e4b3-47cf-8c7f-f946d28880a4', 'd8152f25-5a3e-4eec-8e6f-2e59aa34dd14', 'deea4596-93c2-4986-b744-14290dcddd0e', '3f248ef3-38bb-4122-ac7d-a8dbb6cdf3a7'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:14 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Deleted volume successfully.
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a4fe874b-2ec9-44fc-9bff-45a07c2b7250 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-9b763873-a982-4621-899c-3114aa326b69-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:14 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Created reservations ['594b5569-c413-45bb-bee6-9054a9ef99c7'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "cinder-fba59489-0c3e-4120-b775-3f49542e5643-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.277s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-17fe7af6-187c-4780-a2bd-34c87e8441fe tempest-GroupsV320Test-559925104 None] Delete group completed successfully.
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-fba59489-0c3e-4120-b775-3f49542e5643-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "cinder-quobyte-fba59489-0c3e-4120-b775-3f49542e5643" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-quobyte-fba59489-0c3e-4120-b775-3f49542e5643" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef549a76-282b-4385-ad19-64f1929186d2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643" returned: 0 in 0.533s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fba59489-0c3e-4120-b775-3f49542e5643" returned: 0 in 0.125s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-quobyte-fba59489-0c3e-4120-b775-3f49542e5643" released by "delete_volume" :: held 0.868s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Created reservations ['f618dbfb-1a76-44a1-9b5c-4f791d500ab3', 'b044bf92-a2d3-4706-af18-d7182c205772', 'f9d605ab-ed65-4a7d-ae2a-69fc068055b7', '9e4504c3-f09b-4f7d-a54f-87577e04c649'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.134s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:17 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Deleted volume successfully.
Sep 17 07:40:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-156729fb-2a1d-43ed-9b73-b8b70ad5ffa4 tempest-AttachVolumeTestJSON-1136610169 None] Lock "cinder-fba59489-0c3e-4120-b775-3f49542e5643-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:26 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:40:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Flow 'volume_create_manager' (4007c5af-81e7-424d-8758-c3ef8f301864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c946a56-05b0-4919-977b-ceaff9e36430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c946a56-05b0-4919-977b-ceaff9e36430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1872040069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1af713-9e5e-46d8-a6ad-5fffc543faf4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60dffc58517945d4b5141398f125eaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:27Z,use_quota=True,user_id='ac3d17656f4246dab1c225d7b84971a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02024bda-bcea-4231-a736-09d482576cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02024bda-bcea-4231-a736-09d482576cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bb5d86-24fe-48ab-8b24-874cb277a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bb5d86-24fe-48ab-8b24-874cb277a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1af713-9e5e-46d8-a6ad-5fffc543faf4', 'volume_name': 'volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73124ce9-6ef0-48fc-845e-d0ffef6dcbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73124ce9-6ef0-48fc-845e-d0ffef6dcbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf20c2c8-de48-450b-9825-831b2ed94932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Volume 2f1af713-9e5e-46d8-a6ad-5fffc543faf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4', 'volume_size': 1}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1872040069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1af713-9e5e-46d8-a6ad-5fffc543faf4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60dffc58517945d4b5141398f125eaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:27Z,use_quota=True,user_id='ac3d17656f4246dab1c225d7b84971a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Creating volume 2f1af713-9e5e-46d8-a6ad-5fffc543faf4 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:40:27 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:40:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=32, name=volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:40:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-0df30d7c-d7d6-4faf-9982-6c6eb4ff6d83 req-4346490e-937a-417e-82a1-39786fa2ac1a tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4 1073741824" returned: 0 in 0.731s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-0df30d7c-d7d6-4faf-9982-6c6eb4ff6d83 req-4346490e-937a-417e-82a1-39786fa2ac1a tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-0df30d7c-d7d6-4faf-9982-6c6eb4ff6d83 req-4346490e-937a-417e-82a1-39786fa2ac1a tempest-AttachVolumeShelveTestJSON-134626373 None] Terminate volume connection completed successfully.
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-0df30d7c-d7d6-4faf-9982-6c6eb4ff6d83 req-4346490e-937a-417e-82a1-39786fa2ac1a tempest-AttachVolumeShelveTestJSON-134626373 None] Deleting attachment 9220bd77-991c-4b91-a0dd-3ac0ccd2725f. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4" returned: 0 in 0.140s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] <== create_volume: return (950ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf20c2c8-de48-450b-9825-831b2ed94932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8437a7c8-ae8c-45e5-8b54-8bbb49dc2057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:28 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Volume volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4 (2f1af713-9e5e-46d8-a6ad-5fffc543faf4): created successfully
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8437a7c8-ae8c-45e5-8b54-8bbb49dc2057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Flow 'volume_create_manager' (4007c5af-81e7-424d-8758-c3ef8f301864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9485e844-6f70-4d34-839c-e41e9f7e250a tempest-VolumesTestJSON-2033193500 None] Created volume successfully.
Sep 17 07:40:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Flow 'volume_create_manager' (a40f3444-b7a8-4214-a597-414451a9a856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efba0018-64d5-40bf-a63f-3af49e1c5c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efba0018-64d5-40bf-a63f-3af49e1c5c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2021189875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf391908-cd0f-4eb1-8bf6-f591aeddf906,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60dffc58517945d4b5141398f125eaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:30Z,use_quota=True,user_id='ac3d17656f4246dab1c225d7b84971a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6832fd3-60be-46b7-9ed7-0bd1357def1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6832fd3-60be-46b7-9ed7-0bd1357def1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2aab3a-68ac-4c81-a3a1-1fe76022787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2aab3a-68ac-4c81-a3a1-1fe76022787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf391908-cd0f-4eb1-8bf6-f591aeddf906', 'volume_name': 'volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ace3e9c-6675-4470-96fb-904d4bab0c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ace3e9c-6675-4470-96fb-904d4bab0c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e3859d-24f2-4f05-ac52-af9a2e8dbec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Volume bf391908-cd0f-4eb1-8bf6-f591aeddf906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906', 'volume_size': 1}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2021189875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf391908-cd0f-4eb1-8bf6-f591aeddf906,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60dffc58517945d4b5141398f125eaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:30Z,use_quota=True,user_id='ac3d17656f4246dab1c225d7b84971a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Creating volume bf391908-cd0f-4eb1-8bf6-f591aeddf906 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:40:30 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:40:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:30 devstack quobyte-client[83654]: System call of process 91517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:40:30 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=33, name=volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906 1073741824" returned: 0 in 0.461s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906" returned: 0 in 0.150s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] <== create_volume: return (752ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e3859d-24f2-4f05-ac52-af9a2e8dbec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89db9794-dbf8-438d-ae90-1f4caedb1a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:31 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Volume volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906 (bf391908-cd0f-4eb1-8bf6-f591aeddf906): created successfully
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89db9794-dbf8-438d-ae90-1f4caedb1a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Flow 'volume_create_manager' (a40f3444-b7a8-4214-a597-414451a9a856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e53b1be4-49c6-48ce-a695-c90279511f25 tempest-VolumesTestJSON-2033193500 None] Created volume successfully.
Sep 17 07:40:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Flow 'volume_create_manager' (bedcbbcd-00aa-4620-9d9a-965b2de96c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab64655-01ea-49d4-9075-f50647672b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Flow 'volume_create_manager' (7ba50900-ff12-4b51-8673-ba914504bef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb101854-3887-4274-a4e1-6018d7149075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb101854-3887-4274-a4e1-6018d7149075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-966635912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280e0ddf-f3c3-49f5-8017-642e20e8b4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c2717fb4c24d36a38708216239f65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:34Z,use_quota=True,user_id='87e83c1b280240b6a46a766bee9c7e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14e8ae1f-a497-4a4d-adf4-cff2511cf65a),volume_type_id=14e8ae1f-a497-4a4d-adf4-cff2511cf65a)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07101ebb-da0e-48cd-899e-60092d7d7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07101ebb-da0e-48cd-899e-60092d7d7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978c126a-1ce1-4284-9e51-43e703327841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (978c126a-1ce1-4284-9e51-43e703327841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280e0ddf-f3c3-49f5-8017-642e20e8b4a7', 'volume_name': 'volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1ca0e6-f170-437b-943b-d4218facdd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1ca0e6-f170-437b-943b-d4218facdd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623cb4f1-d8cd-4d3a-8be6-004b54cdbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Volume 280e0ddf-f3c3-49f5-8017-642e20e8b4a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7', 'volume_size': 1}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-966635912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280e0ddf-f3c3-49f5-8017-642e20e8b4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62c2717fb4c24d36a38708216239f65a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:34Z,use_quota=True,user_id='87e83c1b280240b6a46a766bee9c7e4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14e8ae1f-a497-4a4d-adf4-cff2511cf65a),volume_type_id=14e8ae1f-a497-4a4d-adf4-cff2511cf65a)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Creating volume 280e0ddf-f3c3-49f5-8017-642e20e8b4a7 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:40:34 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:34 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=34, name=volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aab64655-01ea-49d4-9075-f50647672b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1119711040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d56675d-7ba4-4f4b-a04c-a190a2f22873,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60dffc58517945d4b5141398f125eaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:34Z,use_quota=True,user_id='ac3d17656f4246dab1c225d7b84971a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d686fef5-151a-49e8-b577-a71e5b94f325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d686fef5-151a-49e8-b577-a71e5b94f325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f437f5ca-2840-4183-86cb-a5aefc7598ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f437f5ca-2840-4183-86cb-a5aefc7598ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d56675d-7ba4-4f4b-a04c-a190a2f22873', 'volume_name': 'volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13a33e7-4581-483e-bc34-7d11375870aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13a33e7-4581-483e-bc34-7d11375870aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e482986-89d8-4d32-a8fb-2fd5c861550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:34 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Volume 8d56675d-7ba4-4f4b-a04c-a190a2f22873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873', 'volume_size': 1}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7 1073741824" returned: 0 in 0.510s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7" returned: 0 in 0.203s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.598s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1119711040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d56675d-7ba4-4f4b-a04c-a190a2f22873,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60dffc58517945d4b5141398f125eaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:34Z,use_quota=True,user_id='ac3d17656f4246dab1c225d7b84971a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Creating volume 8d56675d-7ba4-4f4b-a04c-a190a2f22873 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:40:34 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:40:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:35 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=35, name=volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623cb4f1-d8cd-4d3a-8be6-004b54cdbd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63abf1c5-e36d-4940-a17f-5870354dc356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:35 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Volume volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7 (280e0ddf-f3c3-49f5-8017-642e20e8b4a7): created successfully
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63abf1c5-e36d-4940-a17f-5870354dc356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Flow 'volume_create_manager' (7ba50900-ff12-4b51-8673-ba914504bef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873 1073741824" returned: 0 in 0.591s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873" returned: 0 in 0.354s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:40:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7b49b220-b0cf-4f29-b589-c8450f5c43e8 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Created volume successfully.
Sep 17 07:40:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e482986-89d8-4d32-a8fb-2fd5c861550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496698ab-a7ca-43dc-b935-bd3ae2ee40b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Volume volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873 (8d56675d-7ba4-4f4b-a04c-a190a2f22873): created successfully
Sep 17 07:40:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496698ab-a7ca-43dc-b935-bd3ae2ee40b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Flow 'volume_create_manager' (bedcbbcd-00aa-4620-9d9a-965b2de96c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-27bc79ac-f306-41b0-a274-384d3b688668 tempest-VolumesTestJSON-2033193500 None] Created volume successfully.
Sep 17 07:40:36 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.293s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:37 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ccda0af3-bf45-40db-b42a-0dd5fe7e0a88 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Retype volume completed successfully.
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "cinder-8d56675d-7ba4-4f4b-a04c-a190a2f22873-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Acquiring lock "cinder-280e0ddf-f3c3-49f5-8017-642e20e8b4a7-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Lock "cinder-8d56675d-7ba4-4f4b-a04c-a190a2f22873-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "cinder-280e0ddf-f3c3-49f5-8017-642e20e8b4a7-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "cinder-quobyte-8d56675d-7ba4-4f4b-a04c-a190a2f22873" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Acquiring lock "cinder-quobyte-280e0ddf-f3c3-49f5-8017-642e20e8b4a7" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Lock "cinder-quobyte-8d56675d-7ba4-4f4b-a04c-a190a2f22873" acquired by "delete_volume" :: waited 0.021s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "cinder-quobyte-280e0ddf-f3c3-49f5-8017-642e20e8b4a7" acquired by "delete_volume" :: waited 0.031s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84554852-08c5-44bd-b2cf-45c58d76f0e7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f2f8f8-b848-46bc-b6c7-c09701586a64]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:39 devstack quobyte-client[83654]: System call of process 91570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:40:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873" returned: 0 in 0.601s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8d56675d-7ba4-4f4b-a04c-a190a2f22873" returned: 0 in 0.220s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7" returned: 0 in 0.820s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Lock "cinder-quobyte-8d56675d-7ba4-4f4b-a04c-a190a2f22873" released by "delete_volume" :: held 1.102s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-280e0ddf-f3c3-49f5-8017-642e20e8b4a7" returned: 0 in 0.310s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "cinder-quobyte-280e0ddf-f3c3-49f5-8017-642e20e8b4a7" released by "delete_volume" :: held 1.334s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:40 devstack cinder-volume[83645]: WARNING cinder.quota [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:40:40 devstack cinder-volume[83645]: WARNING cinder.quota [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Created reservations ['dd9841f0-9a82-4332-a563-5a26efd2c1de', '93822677-7a2e-4084-9695-c1744d941311', 'b1c9aea4-10e0-48a5-a941-04c4d37af603', '67e4aec5-85b8-4b79-9315-0f4c2af0d841'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Created reservations ['2186c471-3d05-44d9-8d8a-6f37fd5e7a22', '2aa9a35e-8622-41ca-8a63-d113d9fb3d4b', '31cac537-2379-4140-ae8e-5ccb9b562c1e', 'ba21cb8b-291c-4256-8af2-8b99c177516b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Acquiring lock "cinder-bf391908-cd0f-4eb1-8bf6-f591aeddf906-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.736s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Deleted volume successfully.
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.526s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Lock "cinder-bf391908-cd0f-4eb1-8bf6-f591aeddf906-delete_volume" acquired by "delete_volume" :: waited 0.275s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Deleted volume successfully.
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-389d4a40-57cf-4028-8559-b17003c4b9f0 tempest-VolumesTestJSON-2033193500 None] Lock "cinder-8d56675d-7ba4-4f4b-a04c-a190a2f22873-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6dff5b90-ed18-4d7c-8528-bcce3d152d79 tempest-VolumeRetypeWithoutMigrationTest-788768836 None] Lock "cinder-280e0ddf-f3c3-49f5-8017-642e20e8b4a7-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Acquiring lock "cinder-quobyte-bf391908-cd0f-4eb1-8bf6-f591aeddf906" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Lock "cinder-quobyte-bf391908-cd0f-4eb1-8bf6-f591aeddf906" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f9baae-d22e-449f-87fb-d53e37b0eec9]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906" returned: 0 in 0.642s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-bf391908-cd0f-4eb1-8bf6-f591aeddf906" returned: 0 in 0.146s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Lock "cinder-quobyte-bf391908-cd0f-4eb1-8bf6-f591aeddf906" released by "delete_volume" :: held 1.054s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:42 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Created reservations ['0d546459-fae4-4b8f-9740-ee5645a8ff0f', 'b1700fad-69b1-4ca2-b366-984d3c5c4210', '5abd7465-4f55-4ce0-88d5-ab743bba1fe0', '482e7fb0-c3d6-408d-be4e-79d01353fffc'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.115s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Deleted volume successfully.
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Acquiring lock "cinder-2f1af713-9e5e-46d8-a6ad-5fffc543faf4-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-00293ba9-635d-418e-8cc6-fb9d6056bf6d tempest-VolumesTestJSON-2033193500 None] Lock "cinder-bf391908-cd0f-4eb1-8bf6-f591aeddf906-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Lock "cinder-2f1af713-9e5e-46d8-a6ad-5fffc543faf4-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Acquiring lock "cinder-quobyte-2f1af713-9e5e-46d8-a6ad-5fffc543faf4" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Lock "cinder-quobyte-2f1af713-9e5e-46d8-a6ad-5fffc543faf4" acquired by "delete_volume" :: waited 0.029s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aeff62-9fbf-4ac2-b387-b12c209f57b0]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:45 devstack quobyte-client[83654]: System call of process 91591 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4" returned: 0 in 1.156s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2f1af713-9e5e-46d8-a6ad-5fffc543faf4" returned: 0 in 0.186s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Lock "cinder-quobyte-2f1af713-9e5e-46d8-a6ad-5fffc543faf4" released by "delete_volume" :: held 1.568s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Created reservations ['d92cc04c-aa9c-4008-9ca6-dcad3f203e45', '9149b3e9-fe0a-45fe-b0d5-dce579d4b2fd', '813642a5-7562-4245-aafb-5aff77411b6e', '82999811-920a-49db-a7e7-05df8385e7af'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.358s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:46 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Deleted volume successfully.
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.646s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1a7f0b5f-6b40-4923-bc44-a72880686e2f tempest-VolumesTestJSON-2033193500 None] Lock "cinder-2f1af713-9e5e-46d8-a6ad-5fffc543faf4-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Flow 'volume_create_manager' (a2f22a62-7515-4f9b-ac2f-7c4d1c012bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9906921a-0b19-4608-98c2-4b5238a70ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9906921a-0b19-4608-98c2-4b5238a70ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-895410582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21d0410-8b5a-4967-93e1-612c1697590f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5059869cbe4e9c9d0f328f25697959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:52Z,use_quota=True,user_id='76abdcb5a8f94485bf4f2cf86c1f6da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e649a598-ba49-4363-b8ca-60b0082fba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e649a598-ba49-4363-b8ca-60b0082fba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d0958c-9410-4901-b68c-d476bbe253a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d0958c-9410-4901-b68c-d476bbe253a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21d0410-8b5a-4967-93e1-612c1697590f', 'volume_name': 'volume-f21d0410-8b5a-4967-93e1-612c1697590f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d6e060-463a-40a8-b602-fde85316a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d6e060-463a-40a8-b602-fde85316a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21740b5-10fa-42c6-a82a-319f3543bcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Volume f21d0410-8b5a-4967-93e1-612c1697590f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21d0410-8b5a-4967-93e1-612c1697590f', 'volume_size': 1}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-895410582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21d0410-8b5a-4967-93e1-612c1697590f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5059869cbe4e9c9d0f328f25697959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:52Z,use_quota=True,user_id='76abdcb5a8f94485bf4f2cf86c1f6da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Creating volume f21d0410-8b5a-4967-93e1-612c1697590f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:40:52 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:52 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=36, name=volume-f21d0410-8b5a-4967-93e1-612c1697590f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f 1073741824" returned: 0 in 0.502s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f" returned: 0 in 0.138s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] <== create_volume: return (773ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:40:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21740b5-10fa-42c6-a82a-319f3543bcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21d0410-8b5a-4967-93e1-612c1697590f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071ad8e0-db63-4335-98b6-c9c455d323c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:40:53 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Volume volume-f21d0410-8b5a-4967-93e1-612c1697590f (f21d0410-8b5a-4967-93e1-612c1697590f): created successfully
Sep 17 07:40:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071ad8e0-db63-4335-98b6-c9c455d323c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:40:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Flow 'volume_create_manager' (a2f22a62-7515-4f9b-ac2f-7c4d1c012bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:40:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e61810ca-389d-47a6-9ac4-d854d969b425 tempest-VolumesServicesTestJSON-1738356723 None] Created volume successfully.
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Acquiring lock "cinder-f21d0410-8b5a-4967-93e1-612c1697590f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Lock "cinder-f21d0410-8b5a-4967-93e1-612c1697590f-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:54 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Acquiring lock "cinder-quobyte-f21d0410-8b5a-4967-93e1-612c1697590f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Lock "cinder-quobyte-f21d0410-8b5a-4967-93e1-612c1697590f" acquired by "delete_volume" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd128b87-22c3-4c00-9582-59b5e22cefd1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f" returned: 0 in 0.520s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f21d0410-8b5a-4967-93e1-612c1697590f" returned: 0 in 0.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Lock "cinder-quobyte-f21d0410-8b5a-4967-93e1-612c1697590f" released by "delete_volume" :: held 0.818s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Created reservations ['806a0f93-42de-4739-a912-24eb4a101b9e', 'fe4a7295-8728-4c24-b746-c83da24d6721', '0945254e-2319-4a48-a4b7-1944c9235329', '502d1f77-378f-4e1e-9f20-737eb675be79'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.172s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:40:55 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:40:56 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Deleted volume successfully.
Sep 17 07:40:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec1f53d3-c7e4-43dd-9d40-7b3be214dfb4 tempest-VolumesServicesTestJSON-1738356723 None] Lock "cinder-f21d0410-8b5a-4967-93e1-612c1697590f-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:40:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9854645d-b643-4b78-8b42-347f6c6ed195 tempest-BackendsCapabilitiesAdminTestsJSON-527591238 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83645) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 17 07:40:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5c2ea0f7-fed4-493d-990a-72ebb4fb9cc9 tempest-BackendsCapabilitiesAdminTestsJSON-527591238 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83645) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 17 07:41:05 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=37,cinder:UPDATE=51,cinder:DELETE=5,cinder:INSERT=8 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:41:06 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=51,cinder:INSERT=16,cinder:UPDATE=71,cinder:DELETE=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:41:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-dd30c289-4b30-45b5-ab86-8ffe3191f5fd tempest-GroupSnapshotsV319Test-1900473135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-dd30c289-4b30-45b5-ab86-8ffe3191f5fd tempest-GroupSnapshotsV319Test-1900473135 None] Group tempest-GroupSnapshotsV319Test-Group-554200104: creating
Sep 17 07:41:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-dd30c289-4b30-45b5-ab86-8ffe3191f5fd tempest-GroupSnapshotsV319Test-1900473135 None] Group tempest-GroupSnapshotsV319Test-Group-554200104: created successfully
Sep 17 07:41:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-dd30c289-4b30-45b5-ab86-8ffe3191f5fd tempest-GroupSnapshotsV319Test-1900473135 None] Create group completed successfully.
Sep 17 07:41:11 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Flow 'volume_create_manager' (34ddf88b-0ed4-4550-9e76-10464988b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c2f12c-60e7-479f-a1b7-20c26a09e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c2f12c-60e7-479f-a1b7-20c26a09e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-622611487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d995457f-97db-49a6-9a0a-05f9958843b1,host='devstack@QuobyteHD#QuobyteHD',id=1432c7a3-de04-4d5b-889a-2af23d5e5e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed733e3a539d4bdeaeb2e6938c66db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:41:11Z,use_quota=True,user_id='e27e780cef484554ac0a02bbada48e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fcb1620-6a52-45c5-a861-cf9bce16468f),volume_type_id=8fcb1620-6a52-45c5-a861-cf9bce16468f)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3372432e-16c9-461d-8843-78c43a3360c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3372432e-16c9-461d-8843-78c43a3360c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627269e5-b733-42ce-bbe9-1f620b572c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627269e5-b733-42ce-bbe9-1f620b572c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1432c7a3-de04-4d5b-889a-2af23d5e5e3d', 'volume_name': 'volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f755acf-eb1e-4df5-a1cd-16f694ecfc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f755acf-eb1e-4df5-a1cd-16f694ecfc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cb76c9-d8a5-4e88-b167-ef58b31c5ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:11 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Volume 1432c7a3-de04-4d5b-889a-2af23d5e5e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d', 'volume_size': 1}
Sep 17 07:41:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d995457f-97db-49a6-9a0a-05f9958843b1,created_at=2025-09-17T05:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-622611487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d995457f-97db-49a6-9a0a-05f9958843b1,host='devstack@QuobyteHD#QuobyteHD',id=1432c7a3-de04-4d5b-889a-2af23d5e5e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed733e3a539d4bdeaeb2e6938c66db3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:41:11Z,use_quota=True,user_id='e27e780cef484554ac0a02bbada48e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fcb1620-6a52-45c5-a861-cf9bce16468f),volume_type_id=8fcb1620-6a52-45c5-a861-cf9bce16468f)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Creating volume 1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:41:12 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:12 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=37, name=volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d 1073741824" returned: 0 in 0.875s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" returned: 0 in 0.224s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] <== create_volume: return (1272ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:41:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12cb76c9-d8a5-4e88-b167-ef58b31c5ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e8f8df-45d8-4231-9918-cf35326b26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:14 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Volume volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d (1432c7a3-de04-4d5b-889a-2af23d5e5e3d): created successfully
Sep 17 07:41:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e8f8df-45d8-4231-9918-cf35326b26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Flow 'volume_create_manager' (34ddf88b-0ed4-4550-9e76-10464988b9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:41:14 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fd5c1352-3fd5-4b46-9283-206cf7244e03 tempest-GroupSnapshotsV319Test-1900473135 None] Created volume successfully.
Sep 17 07:41:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] GroupSnapshot 568c9295-df23-4693-a5d3-3db04c4d6ab7: creating.
Sep 17 07:41:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Group snapshot 568c9295-df23-4693-a5d3-3db04c4d6ab7: creating. {{(pid=83645) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 17 07:41:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Creating offline snapshot 485b2072-e58f-4638-ba3a-6cd4edc38f73 of volume 1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:41:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f647b058-4a9d-4653-958f-b52f81825de3]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:16 devstack quobyte-client[83654]: System call of process 91742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" returned: 0 in 1.274s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:17 devstack quobyte-client[83654]: System call of process 91745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:17 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=38, name=volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:41:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 1G" returned: 0 in 0.358s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:18 devstack quobyte-client[83654]: System call of process 91748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "qemu-img rebase -u -b volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73" returned: 0 in 0.394s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73" returned: 0 in 0.153s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73" returned: 0 in 0.114s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.info" returned: 0 in 0.357s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:41:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.info" returned: 0 in 0.395s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.990s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:20 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-22c0a69c-cb40-4da7-b314-799d241b3736 tempest-GroupSnapshotsV319Test-1900473135 None] group_snapshot 568c9295-df23-4693-a5d3-3db04c4d6ab7: created successfully
Sep 17 07:41:22 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] group_snapshot 568c9295-df23-4693-a5d3-3db04c4d6ab7: deleting
Sep 17 07:41:22 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] group_snapshot 568c9295-df23-4693-a5d3-3db04c4d6ab7: deleting {{(pid=83645) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "cinder-quobyte-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "cinder-quobyte-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" acquired by "delete_snapshot" :: waited 0.075s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "cinder-quobyte-485b2072-e58f-4638-ba3a-6cd4edc38f73" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "cinder-quobyte-485b2072-e58f-4638-ba3a-6cd4edc38f73" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Deleting offline snapshot 485b2072-e58f-4638-ba3a-6cd4edc38f73 of volume 1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] snapshot_file for this snap is: volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1666e1-9ad5-4978-95fb-5fca13bea66b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73" returned: 0 in 0.558s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:41:23 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f424733d-792c-4736-9597-511e28780479]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" returned: 0 in 0.570s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73" returned: 0 in 0.381s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d.485b2072-e58f-4638-ba3a-6cd4edc38f73" returned: 0 in 0.141s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "cinder-quobyte-485b2072-e58f-4638-ba3a-6cd4edc38f73" released by "_delete_snapshot" :: held 2.033s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Lock "cinder-quobyte-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" released by "delete_snapshot" :: held 2.088s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:25 devstack cinder-volume[83645]: WARNING cinder.quota [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-979160162 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-979160162, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:41:25 devstack cinder-volume[83645]: WARNING cinder.quota [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-979160162 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-979160162, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:41:25 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] Created reservations ['b4e0ff9d-77a7-4b6e-93c6-0ab7a76abe74', '97738926-09b3-41ad-a1cc-43ac81132155', 'a540f49c-64cd-4300-b7c9-113bfa2c8a99', '4ff964bf-7ce2-45cd-9a21-1105772db116'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:41:25 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fc41620e-4873-4434-8126-e4b9a72fab71 tempest-GroupSnapshotsV319Test-1900473135 None] group_snapshot 568c9295-df23-4693-a5d3-3db04c4d6ab7: deleted successfully
Sep 17 07:41:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "cinder-quobyte-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Lock "cinder-quobyte-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" acquired by "delete_volume" :: waited 0.057s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:26 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e32d24-7f0b-472c-96cf-c76d230ff080]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" returned: 0 in 0.833s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" returned: 0 in 0.172s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Lock "cinder-quobyte-1432c7a3-de04-4d5b-889a-2af23d5e5e3d" released by "delete_volume" :: held 1.232s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Created reservations ['3db039f8-e92d-43cf-8f28-fa5e70b590f3'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:41:28 devstack cinder-volume[83645]: WARNING cinder.quota [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-979160162 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-979160162, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Created reservations ['47068c27-6f64-4aeb-bde8-206c3d5d355a', '5694f41c-7199-4a2b-a85d-6770660d6efd', 'ec5be55c-381a-41be-b7bd-e6f06bda45bb', '586bcb71-39f8-4e42-ba61-e1782d17f1c6'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.245s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:29 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:41:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-71c34ea7-4c7b-4853-b611-a3def56eccaa tempest-GroupSnapshotsV319Test-1900473135 None] Delete group completed successfully.
Sep 17 07:41:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Flow 'volume_create_manager' (6ec8d93d-ce1e-4205-b1f8-3ca1213f9a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432dba70-18a3-43a4-a6a4-5570f032fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432dba70-18a3-43a4-a6a4-5570f032fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1606833886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9131ba74-e70f-4fda-94a8-f151232d72ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f51183a297644d985bae0dbb082d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:41:35Z,use_quota=True,user_id='4fe0acfa72b44b8a95ad586a92f1bf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2bfb14-d2ad-4f3f-a14a-72e47e0ca6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2bfb14-d2ad-4f3f-a14a-72e47e0ca6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1b2b54-0cd6-4a15-98ef-f82ddab6fbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1b2b54-0cd6-4a15-98ef-f82ddab6fbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9131ba74-e70f-4fda-94a8-f151232d72ef', 'volume_name': 'volume-9131ba74-e70f-4fda-94a8-f151232d72ef', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ce0be0-ea17-4dfb-9b6d-3e104d3f6935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ce0be0-ea17-4dfb-9b6d-3e104d3f6935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64be23f-a3f7-4f23-b22d-4006e12403e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:35 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Volume 9131ba74-e70f-4fda-94a8-f151232d72ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9131ba74-e70f-4fda-94a8-f151232d72ef', 'volume_size': 1}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1606833886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9131ba74-e70f-4fda-94a8-f151232d72ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f51183a297644d985bae0dbb082d5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:41:35Z,use_quota=True,user_id='4fe0acfa72b44b8a95ad586a92f1bf3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Creating volume 9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:41:35 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:41:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:35 devstack quobyte-client[83654]: System call of process 91780 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:35 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=40, name=volume-9131ba74-e70f-4fda-94a8-f151232d72ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef 1073741824" returned: 0 in 0.492s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef" returned: 0 in 0.251s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] <== create_volume: return (901ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64be23f-a3f7-4f23-b22d-4006e12403e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9131ba74-e70f-4fda-94a8-f151232d72ef', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08f6b10-ba08-428f-9c9c-0518d4f65cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:41:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Volume volume-9131ba74-e70f-4fda-94a8-f151232d72ef (9131ba74-e70f-4fda-94a8-f151232d72ef): created successfully
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08f6b10-ba08-428f-9c9c-0518d4f65cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:41:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Flow 'volume_create_manager' (6ec8d93d-ce1e-4205-b1f8-3ca1213f9a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:41:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a7231866-85f0-4c21-a050-1be887efb638 tempest-SnapshotMetadataTestJSON-423702438 None] Created volume successfully.
Sep 17 07:41:37 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Creating offline snapshot 3d846053-89b2-4a01-ba76-0c9a15eb1930 of volume 9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:41:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee6dc5d-d897-43a7-ab2e-57ce8dc3ee52]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef" returned: 0 in 0.673s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:38 devstack quobyte-client[83654]: System call of process 91787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:39 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=41, name=volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 1G" returned: 0 in 0.567s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9131ba74-e70f-4fda-94a8-f151232d72ef -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "qemu-img rebase -u -b volume-9131ba74-e70f-4fda-94a8-f151232d72ef -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930" returned: 0 in 0.255s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930" returned: 0 in 0.272s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930" returned: 0 in 0.198s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.info" returned: 0 in 0.158s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.info" returned: 0 in 0.131s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2a295008-08e7-4dd0-9243-b8ec133269b8 tempest-SnapshotMetadataTestJSON-423702438 None] Create snapshot completed successfully
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "cinder-3d846053-89b2-4a01-ba76-0c9a15eb1930-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-3d846053-89b2-4a01-ba76-0c9a15eb1930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "cinder-quobyte-9131ba74-e70f-4fda-94a8-f151232d72ef" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-quobyte-9131ba74-e70f-4fda-94a8-f151232d72ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "cinder-quobyte-3d846053-89b2-4a01-ba76-0c9a15eb1930" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-quobyte-3d846053-89b2-4a01-ba76-0c9a15eb1930" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Deleting offline snapshot 3d846053-89b2-4a01-ba76-0c9a15eb1930 of volume 9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] snapshot_file for this snap is: volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca50f640-e659-473f-b5f7-eb742243abc1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:44 devstack quobyte-client[83654]: System call of process 91813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930" returned: 0 in 0.594s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9131ba74-e70f-4fda-94a8-f151232d72ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:41:44 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[901fb6ed-35ab-45dd-9861-39513f2b99a1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef" returned: 0 in 0.832s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:45 devstack quobyte-client[83654]: System call of process 91837 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930" returned: 0 in 0.558s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.114s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef.3d846053-89b2-4a01-ba76-0c9a15eb1930" returned: 0 in 0.834s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.505s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:41:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-quobyte-3d846053-89b2-4a01-ba76-0c9a15eb1930" released by "_delete_snapshot" :: held 3.582s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-quobyte-9131ba74-e70f-4fda-94a8-f151232d72ef" released by "delete_snapshot" :: held 3.638s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:47 devstack cinder-volume[83645]: WARNING cinder.quota [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:41:47 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Created reservations ['9a05ac5b-f530-4bd3-b6f8-34c34c20468e', '7ceb528c-9416-474b-a724-68e1a2d7a67a', '72a2d7b3-fed5-44e4-b56b-4708eee08ded', 'd9837984-5798-4bd5-a811-66950f8a59e7'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:41:47 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Delete snapshot completed successfully.
Sep 17 07:41:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-38206355-e334-4c77-9fb8-67fd5b084bd4 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-3d846053-89b2-4a01-ba76-0c9a15eb1930-delete_snapshot" released by "delete_snapshot" :: held 4.320s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "cinder-9131ba74-e70f-4fda-94a8-f151232d72ef-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-9131ba74-e70f-4fda-94a8-f151232d72ef-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "cinder-quobyte-9131ba74-e70f-4fda-94a8-f151232d72ef" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-quobyte-9131ba74-e70f-4fda-94a8-f151232d72ef" acquired by "delete_volume" :: waited 0.033s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2d753-03e7-4e17-b6db-ce229c900fd7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:49 devstack quobyte-client[83654]: System call of process 91871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef" returned: 0 in 0.544s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9131ba74-e70f-4fda-94a8-f151232d72ef" returned: 0 in 0.164s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-quobyte-9131ba74-e70f-4fda-94a8-f151232d72ef" released by "delete_volume" :: held 1.046s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:41:50 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Created reservations ['6ea903c6-3a5e-4e26-b773-8b8fffeabedb', 'fc97777c-1f96-47a2-a52e-4e033f283ea1', 'cddd887f-7f94-4baa-bc5c-246311ec8c10', '1d48ed07-daf3-45a4-874e-d1ae40331762'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.221s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:41:51 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Deleted volume successfully.
Sep 17 07:41:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-974abd1f-9261-4fa6-ba18-26e232dcdad3 tempest-SnapshotMetadataTestJSON-423702438 None] Lock "cinder-9131ba74-e70f-4fda-94a8-f151232d72ef-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Flow 'volume_create_manager' (e9d0611d-aa00-4188-85d6-de7e47f505b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a7d666-d39b-4c30-b439-0839ba1c15bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a7d666-d39b-4c30-b439-0839ba1c15bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1606984836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6186998-a37e-44f9-8a82-15e9eb8ceacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2c1d45a45b4a2b95b12e1e92cc193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:00Z,use_quota=True,user_id='1096886af9b54c0ebad39c9a9a37fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4d17d8-b32b-4586-b8ed-3237d4a914c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d4d17d8-b32b-4586-b8ed-3237d4a914c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb7607e-2a32-4566-abe4-462959526fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb7607e-2a32-4566-abe4-462959526fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6186998-a37e-44f9-8a82-15e9eb8ceacd', 'volume_name': 'volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c15061-a05f-43b8-833d-e2cf0c862b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c15061-a05f-43b8-833d-e2cf0c862b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0e4c13-87ab-4e12-84dd-31d05ffe7d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:00 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Volume f6186998-a37e-44f9-8a82-15e9eb8ceacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd', 'volume_size': 1}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1606984836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6186998-a37e-44f9-8a82-15e9eb8ceacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2c1d45a45b4a2b95b12e1e92cc193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:00Z,use_quota=True,user_id='1096886af9b54c0ebad39c9a9a37fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Creating volume f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:42:00 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:42:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:01 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=43, name=volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd 1073741824" returned: 0 in 0.535s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.125s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] <== create_volume: return (775ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0e4c13-87ab-4e12-84dd-31d05ffe7d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cf36e2-db5a-4c3c-b7cf-34c13fea047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:01 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Volume volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd (f6186998-a37e-44f9-8a82-15e9eb8ceacd): created successfully
Sep 17 07:42:01 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cf36e2-db5a-4c3c-b7cf-34c13fea047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Flow 'volume_create_manager' (e9d0611d-aa00-4188-85d6-de7e47f505b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:02 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5fca87a5-dee6-475d-b0c0-6eb9abcb0f9a tempest-VolumesDeleteCascade-1092800146 None] Created volume successfully.
Sep 17 07:42:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Creating offline snapshot 390c9303-7c44-4355-97c0-f959f31889dd of volume f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d5ab6-ed1f-49e5-9c2d-98b32cd127f0]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.594s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:03 devstack quobyte-client[83654]: System call of process 91893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:04 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=44, name=volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd 1G" returned: 0 in 0.360s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:04 devstack quobyte-client[83654]: System call of process 91896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img rebase -u -b volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.227s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.122s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.133s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.info" returned: 0 in 0.144s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.info" returned: 0 in 0.143s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e6c732b5-a511-4295-b47d-d01644bb0a4a tempest-VolumesDeleteCascade-1092800146 None] Create snapshot completed successfully
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=36,cinder:UPDATE=43,cinder:INSERT=7 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=42,cinder:UPDATE=41,cinder:DELETE=6,cinder:INSERT=10 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:42:07 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Creating offline snapshot 63df162e-9da3-46f7-8c6a-66036f18661a of volume f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3253cc7-fdae-41e2-ae81-8e8269ce0b85]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.596s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:08 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=46, name=volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a 1G" returned: 0 in 0.374s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img rebase -u -b volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.218s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.144s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.131s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4e0323f1-9bfe-4e8d-ae7b-6b92d9602058 tempest-VolumesDeleteCascade-1092800146 None] Create snapshot completed successfully
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-f6186998-a37e-44f9-8a82-15e9eb8ceacd-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-f6186998-a37e-44f9-8a82-15e9eb8ceacd-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Performing cascade delete. {{(pid=83645) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-390c9303-7c44-4355-97c0-f959f31889dd-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-390c9303-7c44-4355-97c0-f959f31889dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-390c9303-7c44-4355-97c0-f959f31889dd" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-390c9303-7c44-4355-97c0-f959f31889dd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Deleting offline snapshot 390c9303-7c44-4355-97c0-f959f31889dd of volume f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] snapshot_file for this snap is: volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e95fb7-1a6d-4e0c-a3b4-0db687ed027a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.607s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:11 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb63f5b-70e7-476c-9653-3df959dafbab]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.746s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c493e6-865b-41b3-8efc-c6efdf002ceb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.545s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a7552-641c-405a-835c-ebee03a24a08]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.528s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[557fd86c-f429-4964-adf8-78b90cb6213b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.605s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:14 devstack quobyte-client[83654]: System call of process 91945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.319s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.390c9303-7c44-4355-97c0-f959f31889dd" returned: 0 in 0.191s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a -F qcow2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:15 devstack quobyte-client[83654]: System call of process 91949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img rebase -u -b volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a -F qcow2" returned: 0 in 0.275s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-390c9303-7c44-4355-97c0-f959f31889dd" released by "_delete_snapshot" :: held 4.518s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" released by "delete_snapshot" :: held 4.554s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:15 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Created reservations ['e37cf854-b2b0-4e35-8ddf-2fc6bb9a0340', 'e987f871-644f-48ea-bfa5-e5ad1a5b7414', 'a695476a-1126-4608-8e6c-5fb9bf20811e', 'fab4e19e-f832-4cd5-9458-bcb030fbda88'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Delete snapshot completed successfully.
Sep 17 07:42:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-390c9303-7c44-4355-97c0-f959f31889dd-delete_snapshot" released by "delete_snapshot" :: held 5.167s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-63df162e-9da3-46f7-8c6a-66036f18661a-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-63df162e-9da3-46f7-8c6a-66036f18661a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:16 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-63df162e-9da3-46f7-8c6a-66036f18661a" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-63df162e-9da3-46f7-8c6a-66036f18661a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Deleting offline snapshot 63df162e-9da3-46f7-8c6a-66036f18661a of volume f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] snapshot_file for this snap is: volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a377e2d-6ccf-4efc-896a-033d2f79b9f1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.595s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e21a2b-e8c7-4967-9cb0-efe4c4b373a3]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.897s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.260s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd.63df162e-9da3-46f7-8c6a-66036f18661a" returned: 0 in 0.132s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-63df162e-9da3-46f7-8c6a-66036f18661a" released by "_delete_snapshot" :: held 2.229s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" released by "delete_snapshot" :: held 2.250s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Created reservations ['aa56c4fd-90bc-4c76-bb59-4efa9714c09c', 'dacc04bb-57e8-4be8-a1b0-1d09fda7025a', '2236c2eb-8ae0-432f-8220-a267c1ca9ba0', '6638399f-dd14-440e-82cf-2392b468700d'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Delete snapshot completed successfully.
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-63df162e-9da3-46f7-8c6a-66036f18661a-delete_snapshot" released by "delete_snapshot" :: held 2.892s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Snapshots deleted, issuing volume delete {{(pid=83645) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" acquired by "delete_volume" :: waited 0.021s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c7ca5-6547-4337-9e26-941e0b794c59]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.528s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f6186998-a37e-44f9-8a82-15e9eb8ceacd" returned: 0 in 0.187s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-f6186998-a37e-44f9-8a82-15e9eb8ceacd" released by "delete_volume" :: held 1.099s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Created reservations ['b9731f64-e5b1-4722-b177-52cd260eaca1', '064e18d4-abb2-4467-a8c7-1f6c18a48986', 'fde903c8-21eb-4f1a-ba36-d009d32becb5', '2a87631c-8505-4a13-8cb2-9b8ba4a3e122'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.213s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:20 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:42:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Deleted volume successfully.
Sep 17 07:42:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0630bc8b-d54f-44d6-b165-1ee4fd4b4398 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-f6186998-a37e-44f9-8a82-15e9eb8ceacd-delete_volume" released by "delete_volume" :: held 10.847s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:22 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:22 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Flow 'volume_create_manager' (b603af6a-4708-46aa-aa78-6bf3fd1f231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee566878-225e-4b89-8a0d-c838836bbecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee566878-225e-4b89-8a0d-c838836bbecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1643198692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567cad1f-5d1a-44bb-85af-eacbbad8d8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2c1d45a45b4a2b95b12e1e92cc193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:22Z,use_quota=True,user_id='1096886af9b54c0ebad39c9a9a37fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b82bb5-2f35-46fe-8b8a-b5fb5c18f8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b82bb5-2f35-46fe-8b8a-b5fb5c18f8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771db415-1a3a-49bd-aae0-28a26d01426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771db415-1a3a-49bd-aae0-28a26d01426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567cad1f-5d1a-44bb-85af-eacbbad8d8bf', 'volume_name': 'volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a15d24e-2938-4b09-83dd-5d348402327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a15d24e-2938-4b09-83dd-5d348402327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82e58d1-5fd5-4086-9b24-2fd9d54007db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:23 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Volume 567cad1f-5d1a-44bb-85af-eacbbad8d8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf', 'volume_size': 1}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1643198692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567cad1f-5d1a-44bb-85af-eacbbad8d8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2c1d45a45b4a2b95b12e1e92cc193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:22Z,use_quota=True,user_id='1096886af9b54c0ebad39c9a9a37fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Creating volume 567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:42:23 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:42:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:23 devstack quobyte-client[83654]: System call of process 91977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:23 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=47, name=volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf 1073741824" returned: 0 in 0.690s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 0.371s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] <== create_volume: return (1218ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:42:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82e58d1-5fd5-4086-9b24-2fd9d54007db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74772b7a-b351-4b2b-9513-beb0771e6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Flow 'volume_create_manager' (cd39bb63-428e-4f96-b8dc-835dad236011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15d60b4-097b-4d06-9fe1-09550caec905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:25 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Volume volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf (567cad1f-5d1a-44bb-85af-eacbbad8d8bf): created successfully
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74772b7a-b351-4b2b-9513-beb0771e6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Flow 'volume_create_manager' (b603af6a-4708-46aa-aa78-6bf3fd1f231d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e15d60b4-097b-4d06-9fe1-09550caec905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1520428857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfa5b36-b524-4870-a770-4063c4576e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf549b0c9efb477fb085fe1a615349e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:25Z,use_quota=True,user_id='5b0b28c23ddb42d3b2edd2af6bd6473d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c93e32f-52e9-4a67-8346-caddf7c96bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c93e32f-52e9-4a67-8346-caddf7c96bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cf9282-ccba-44f5-9968-591895616c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cf9282-ccba-44f5-9968-591895616c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccfa5b36-b524-4870-a770-4063c4576e5f', 'volume_name': 'volume-ccfa5b36-b524-4870-a770-4063c4576e5f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714481a0-aa2a-4fe5-8242-88aabea821c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714481a0-aa2a-4fe5-8242-88aabea821c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4c21fe-dbea-4b94-a943-cb35100396f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:25 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume ccfa5b36-b524-4870-a770-4063c4576e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccfa5b36-b524-4870-a770-4063c4576e5f', 'volume_size': 1}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1520428857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccfa5b36-b524-4870-a770-4063c4576e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf549b0c9efb477fb085fe1a615349e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:25Z,use_quota=True,user_id='5b0b28c23ddb42d3b2edd2af6bd6473d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Creating volume ccfa5b36-b524-4870-a770-4063c4576e5f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:42:25 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:25 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=48, name=volume-ccfa5b36-b524-4870-a770-4063c4576e5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:25 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f47dee40-3f9b-4fbb-bd48-1c865f6590e5 tempest-VolumesDeleteCascade-1092800146 None] Created volume successfully.
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f 1073741824" returned: 0 in 0.583s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f" returned: 0 in 0.174s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] <== create_volume: return (803ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4c21fe-dbea-4b94-a943-cb35100396f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccfa5b36-b524-4870-a770-4063c4576e5f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf26f7c-47e0-42c6-aa6d-efc098631e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:26 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume volume-ccfa5b36-b524-4870-a770-4063c4576e5f (ccfa5b36-b524-4870-a770-4063c4576e5f): created successfully
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf26f7c-47e0-42c6-aa6d-efc098631e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Flow 'volume_create_manager' (cd39bb63-428e-4f96-b8dc-835dad236011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Creating offline snapshot 42bf3968-d436-48d0-a150-707c44b54c41 of volume 567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[690bdded-6dac-4144-ab95-9c8616ded9d2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:26 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0f556779-22ac-4175-8611-c66ba58eebe1 tempest-AttachVolumeShelveTestJSON-134626373 None] Created volume successfully.
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 0.697s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:27 devstack quobyte-client[83654]: System call of process 91992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=49, name=volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 1G" returned: 0 in 0.300s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img rebase -u -b volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img rebase -u -b volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.201s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.129s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.info" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.info" returned: 0 in 0.127s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-cd5a96a7-3823-43e6-b64a-0f7a045fe743 tempest-VolumesDeleteCascade-1092800146 None] Create snapshot completed successfully
Sep 17 07:42:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Flow 'volume_create_manager' (82c10aaf-8f3b-4f20-b8bd-6c262db336cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203eaee9-1aa8-4217-a13c-558617d26f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203eaee9-1aa8-4217-a13c-558617d26f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-933883972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0006e44-a362-4c3b-9faf-28ef84349315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2c1d45a45b4a2b95b12e1e92cc193b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42bf3968-d436-48d0-a150-707c44b54c41,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:30Z,use_quota=True,user_id='1096886af9b54c0ebad39c9a9a37fef4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed71344-ed13-4860-a49e-814917881dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed71344-ed13-4860-a49e-814917881dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4b3775-58e0-4333-9d73-b49425d183b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4b3775-58e0-4333-9d73-b49425d183b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0006e44-a362-4c3b-9faf-28ef84349315', 'volume_name': 'volume-a0006e44-a362-4c3b-9faf-28ef84349315', 'volume_size': 1, 'snapshot_id': '42bf3968-d436-48d0-a150-707c44b54c41'}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ddaf42-946b-42b4-afc8-a65c0c5e0ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ddaf42-946b-42b4-afc8-a65c0c5e0ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3799cea-c62f-4761-ae10-c343870c7adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Volume a0006e44-a362-4c3b-9faf-28ef84349315: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0006e44-a362-4c3b-9faf-28ef84349315', 'volume_size': 1, 'snapshot_id': '42bf3968-d436-48d0-a150-707c44b54c41'}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-42bf3968-d436-48d0-a150-707c44b54c41-a0006e44-a362-4c3b-9faf-28ef84349315" by "_create_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-42bf3968-d436-48d0-a150-707c44b54c41-a0006e44-a362-4c3b-9faf-28ef84349315" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Creating volume a0006e44-a362-4c3b-9faf-28ef84349315 from snapshot 42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-a0006e44-a362-4c3b-9faf-28ef84349315" by "_copy_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-a0006e44-a362-4c3b-9faf-28ef84349315" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] snapshot: 42bf3968-d436-48d0-a150-707c44b54c41, volume: a0006e44-a362-4c3b-9faf-28ef84349315,  {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[760ebcba-c59f-4dc9-8646-9a8a72504291]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:31 devstack quobyte-client[83654]: System call of process 92003 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.669s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 07:42:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Creating direct copy from snapshot {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 07:42:31 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[73280840-7bd2-445b-acea-c30c6647d61f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 1.599s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:33 devstack cinder-volume[83645]: DEBUG cinder.utils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 not found in is_blk_device check {{(pid=83645) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 07:42:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:33 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=51, name=volume-a0006e44-a362-4c3b-9faf-28ef84349315, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:33 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:42:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Flow 'volume_create_manager' (5d572957-52c5-46fb-816e-ee2258792bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9879444f-993d-4d18-8448-a223e5147ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9879444f-993d-4d18-8448-a223e5147ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-435826218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b7fe2-ea40-435f-af65-72cdbc948f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4947fed550d4783bec27ed861c84d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:32Z,use_quota=True,user_id='1593fd79cc1a4021b50c30bd4ccddc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098564a0-96ba-4af0-b522-d68d69b7f96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098564a0-96ba-4af0-b522-d68d69b7f96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997193df-f610-48e4-8fcb-4a27f5aabcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997193df-f610-48e4-8fcb-4a27f5aabcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120b7fe2-ea40-435f-af65-72cdbc948f8f', 'volume_name': 'volume-120b7fe2-ea40-435f-af65-72cdbc948f8f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f5e1f9-a583-44ef-8d2a-3276f4a60e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f5e1f9-a583-44ef-8d2a-3276f4a60e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025327cf-ce34-40ab-9770-8b48249e56b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:34 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume 120b7fe2-ea40-435f-af65-72cdbc948f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120b7fe2-ea40-435f-af65-72cdbc948f8f', 'volume_size': 1}
Sep 17 07:42:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315" returned: 0 in 7.630s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:40 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[be088191-33a7-46e9-bbb4-5ec42aa097e2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 0.623s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Image conversion details: src /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:42:41 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Converted 1024.00 MB image at 134.11 MB/s
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-a0006e44-a362-4c3b-9faf-28ef84349315" released by "_copy_volume_from_snapshot" :: held 11.155s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-42bf3968-d436-48d0-a150-707c44b54c41-a0006e44-a362-4c3b-9faf-28ef84349315" released by "_create_volume_from_snapshot" :: held 11.200s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.222s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.871s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-435826218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120b7fe2-ea40-435f-af65-72cdbc948f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4947fed550d4783bec27ed861c84d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:32Z,use_quota=True,user_id='1593fd79cc1a4021b50c30bd4ccddc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Creating volume 120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:42:42 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:42 devstack quobyte-client[83654]: System call of process 92073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:42 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=52, name=volume-120b7fe2-ea40-435f-af65-72cdbc948f8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3799cea-c62f-4761-ae10-c343870c7adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0006e44-a362-4c3b-9faf-28ef84349315', 'volume_size': 1, 'snapshot_id': '42bf3968-d436-48d0-a150-707c44b54c41'}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bd4634-152e-4f89-a185-19211981655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f 1073741824" returned: 0 in 0.500s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f" returned: 0 in 0.165s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] <== create_volume: return (736ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:42 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Volume volume-a0006e44-a362-4c3b-9faf-28ef84349315 (a0006e44-a362-4c3b-9faf-28ef84349315): created successfully
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08bd4634-152e-4f89-a185-19211981655c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Flow 'volume_create_manager' (82c10aaf-8f3b-4f20-b8bd-6c262db336cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025327cf-ce34-40ab-9770-8b48249e56b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120b7fe2-ea40-435f-af65-72cdbc948f8f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aab15d-9672-48fc-84f9-9ab47888ac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:42:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fff04546-5856-42d7-accb-9e0cfc3576f7 tempest-VolumesDeleteCascade-1092800146 None] Created volume successfully.
Sep 17 07:42:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume volume-120b7fe2-ea40-435f-af65-72cdbc948f8f (120b7fe2-ea40-435f-af65-72cdbc948f8f): created successfully
Sep 17 07:42:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aab15d-9672-48fc-84f9-9ab47888ac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:42:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Flow 'volume_create_manager' (5d572957-52c5-46fb-816e-ee2258792bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:42:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-63e6fe9c-2737-407c-9249-1354821df8fc tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Created volume successfully.
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-567cad1f-5d1a-44bb-85af-eacbbad8d8bf-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-567cad1f-5d1a-44bb-85af-eacbbad8d8bf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Performing cascade delete. {{(pid=83645) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-42bf3968-d436-48d0-a150-707c44b54c41-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-42bf3968-d436-48d0-a150-707c44b54c41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-42bf3968-d436-48d0-a150-707c44b54c41" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-42bf3968-d436-48d0-a150-707c44b54c41" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Deleting offline snapshot 42bf3968-d436-48d0-a150-707c44b54c41 of volume 567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] snapshot_file for this snap is: volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf58e1a-91e0-4a30-815a-15af8b2f0bbf]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.723s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:45 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc59d8b-acc3-40fe-aa92-2d4c81a851ba]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Creating offline snapshot 9db38167-2d0c-4bea-8f4a-fa09984013da of volume 120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f08a6-1158-4f2f-8ff1-e9bbbd769f97]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 0.544s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f" returned: 0 in 0.610s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.340s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:46 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=53, name=volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf.42bf3968-d436-48d0-a150-707c44b54c41" returned: 0 in 0.183s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da 1G" returned: 0 in 0.533s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.301s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-120b7fe2-ea40-435f-af65-72cdbc948f8f -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:42:46 devstack quobyte-client[83654]: System call of process 92095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-42bf3968-d436-48d0-a150-707c44b54c41" released by "_delete_snapshot" :: held 2.610s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "qemu-img rebase -u -b volume-120b7fe2-ea40-435f-af65-72cdbc948f8f -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da" returned: 0 in 0.343s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" released by "delete_snapshot" :: held 2.838s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da" returned: 0 in 0.708s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:42:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da" returned: 0 in 0.432s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.info" returned: 0 in 0.574s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:42:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Created reservations ['9ebf5d3d-1ce2-48c8-9f83-2a0f452c3b9c', '1c05cb5c-04b2-4775-a0e6-fc98b037dd56', 'e11c4f29-acdf-4a13-be08-79396ab94cdc', '64ac1869-566d-4a53-a3c7-af38ab30066c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.info" returned: 0 in 0.436s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Delete snapshot completed successfully.
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-42bf3968-d436-48d0-a150-707c44b54c41-delete_snapshot" released by "delete_snapshot" :: held 5.158s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Snapshots deleted, issuing volume delete {{(pid=83645) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-bc4f787d-69a6-46f8-aa21-b6cd1d691557 tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Create snapshot completed successfully
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" acquired by "delete_volume" :: waited 0.042s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e14415-a25f-4609-a2a0-8d248e8d2da2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 0.505s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" returned: 0 in 0.204s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-567cad1f-5d1a-44bb-85af-eacbbad8d8bf" released by "delete_volume" :: held 1.034s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:50 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Created reservations ['0b0df64e-efeb-45fd-9f60-be058ec4aba9', '606568c3-172d-4043-9550-9bb9a00a865b', '88aa8025-e263-4592-b638-fc3f2f53f1ab', 'ef20819e-4c52-4663-b773-c1c608e9985e'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "cinder-9db38167-2d0c-4bea-8f4a-fa09984013da-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-9db38167-2d0c-4bea-8f4a-fa09984013da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.116s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "cinder-quobyte-120b7fe2-ea40-435f-af65-72cdbc948f8f" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-quobyte-120b7fe2-ea40-435f-af65-72cdbc948f8f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "cinder-quobyte-9db38167-2d0c-4bea-8f4a-fa09984013da" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-quobyte-9db38167-2d0c-4bea-8f4a-fa09984013da" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Deleting offline snapshot 9db38167-2d0c-4bea-8f4a-fa09984013da of volume 120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] snapshot_file for this snap is: volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb36b47-c4e8-4abf-afc5-cf3740548dca]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.233s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:51 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:42:51 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Deleted volume successfully.
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7c2b10f4-26de-4786-aef4-fcdf6ba736e6 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-567cad1f-5d1a-44bb-85af-eacbbad8d8bf-delete_volume" released by "delete_volume" :: held 8.274s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-a0006e44-a362-4c3b-9faf-28ef84349315-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da" returned: 0 in 1.045s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-120b7fe2-ea40-435f-af65-72cdbc948f8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-a0006e44-a362-4c3b-9faf-28ef84349315-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0cc61f-e6f8-4353-b1db-e5302089dbb1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:53 devstack quobyte-client[83654]: System call of process 92144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "cinder-quobyte-a0006e44-a362-4c3b-9faf-28ef84349315" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f" returned: 0 in 1.021s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:54 devstack quobyte-client[83654]: System call of process 92148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-a0006e44-a362-4c3b-9faf-28ef84349315" acquired by "delete_volume" :: waited 0.320s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e6621-541b-425b-9db0-a5d569176329]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da" returned: 0 in 0.507s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f.9db38167-2d0c-4bea-8f4a-fa09984013da" returned: 0 in 0.235s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-quobyte-9db38167-2d0c-4bea-8f4a-fa09984013da" released by "_delete_snapshot" :: held 3.361s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-quobyte-120b7fe2-ea40-435f-af65-72cdbc948f8f" released by "delete_snapshot" :: held 3.392s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-565d5e7e-e3d4-4221-8041-8d16db8f788a req-b79915e4-0894-43f8-8a94-7008377c39d9 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315" returned: 0 in 0.924s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-565d5e7e-e3d4-4221-8041-8d16db8f788a req-b79915e4-0894-43f8-8a94-7008377c39d9 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-565d5e7e-e3d4-4221-8041-8d16db8f788a req-b79915e4-0894-43f8-8a94-7008377c39d9 tempest-AttachVolumeShelveTestJSON-134626373 None] No connector for attachment 535cf0f9-1132-46a9-bbbf-2937f1ebfc4b; skipping storage backend terminate_connection call. {{(pid=83645) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-565d5e7e-e3d4-4221-8041-8d16db8f788a req-b79915e4-0894-43f8-8a94-7008377c39d9 tempest-AttachVolumeShelveTestJSON-134626373 None] Deleting attachment 535cf0f9-1132-46a9-bbbf-2937f1ebfc4b. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a0006e44-a362-4c3b-9faf-28ef84349315" returned: 0 in 0.401s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-quobyte-a0006e44-a362-4c3b-9faf-28ef84349315" released by "delete_volume" :: held 1.622s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Created reservations ['fe241e14-6e04-4054-9f4e-fdd9f3b21ea7', '1eedef71-c63a-485a-9082-ecfad05b6dd6', 'bb69ad62-ec1a-48e3-9100-dfe99b1b445b', 'd75c6c56-1188-4643-97c1-a06b6d02de2c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Created reservations ['caefa271-b3b7-4756-97db-61a45263ffe7', 'd79ea4a4-3d2b-44ca-a81a-d1f43648a62b', '5c622c3b-ddfc-462e-8be2-721a5d2a52ba', 'f8d83ab8-6c03-4b30-a1a0-6f4d4026eaf2'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Delete snapshot completed successfully.
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bb975044-4537-4e92-8d07-96ea039e4f1b tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-9db38167-2d0c-4bea-8f4a-fa09984013da-delete_snapshot" released by "delete_snapshot" :: held 4.523s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.151s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:56 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:42:56 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Deleted volume successfully.
Sep 17 07:42:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3cbfe09a-ad7a-42a8-883a-7ac22d29b9c5 tempest-VolumesDeleteCascade-1092800146 None] Lock "cinder-a0006e44-a362-4c3b-9faf-28ef84349315-delete_volume" released by "delete_volume" :: held 3.911s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "cinder-120b7fe2-ea40-435f-af65-72cdbc948f8f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-120b7fe2-ea40-435f-af65-72cdbc948f8f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "cinder-quobyte-120b7fe2-ea40-435f-af65-72cdbc948f8f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-quobyte-120b7fe2-ea40-435f-af65-72cdbc948f8f" acquired by "delete_volume" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae848c92-e380-43be-85f5-f1c80878e39d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f" returned: 0 in 0.597s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-120b7fe2-ea40-435f-af65-72cdbc948f8f" returned: 0 in 0.152s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-quobyte-120b7fe2-ea40-435f-af65-72cdbc948f8f" released by "delete_volume" :: held 0.947s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Created reservations ['e5da0e9b-47b9-4fca-a23f-85db1e05e72e', '361f97dd-5fd4-4b90-a4a9-f24aa49d6b60', 'ac2cb238-c20c-4e4e-9cf4-ba1725bc70a6', 'fbe550ba-104c-4a5c-92e9-88a2de9db55c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:42:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:42:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.131s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:42:59 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:42:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Deleted volume successfully.
Sep 17 07:42:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbbcd2a7-eb09-43bc-9b4a-e19027d2c2ca tempest-VolumeSnapshotQuotasNegativeTestJSON-809547405 None] Lock "cinder-120b7fe2-ea40-435f-af65-72cdbc948f8f-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Flow 'volume_create_manager' (75e37d34-0fc0-44bf-b90b-824dd0d7d144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f99440-717d-4139-a068-e7ef2bf695f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f99440-717d-4139-a068-e7ef2bf695f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1749110010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babf3294-ccb1-41e0-953a-0fa371b25901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7453a7db81b4de299b2b0fdf5154ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:03Z,use_quota=True,user_id='8e2cb87e96b74e62a7877cc0f765147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b37ac0-1aa6-483b-9619-3204f66fdac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b37ac0-1aa6-483b-9619-3204f66fdac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dee4bb-93e0-47d0-bd99-850649704b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dee4bb-93e0-47d0-bd99-850649704b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babf3294-ccb1-41e0-953a-0fa371b25901', 'volume_name': 'volume-babf3294-ccb1-41e0-953a-0fa371b25901', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b356c41-3abf-4417-b3f3-a8c20d1ed85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b356c41-3abf-4417-b3f3-a8c20d1ed85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0f8aa7-9669-4bcd-be53-1997cd99ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:03 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Volume babf3294-ccb1-41e0-953a-0fa371b25901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babf3294-ccb1-41e0-953a-0fa371b25901', 'volume_size': 1}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1749110010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babf3294-ccb1-41e0-953a-0fa371b25901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7453a7db81b4de299b2b0fdf5154ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:03Z,use_quota=True,user_id='8e2cb87e96b74e62a7877cc0f765147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Creating volume babf3294-ccb1-41e0-953a-0fa371b25901 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:43:03 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:43:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:03 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=55, name=volume-babf3294-ccb1-41e0-953a-0fa371b25901, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901 1073741824" returned: 0 in 0.478s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901" returned: 0 in 0.115s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] <== create_volume: return (686ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a0f8aa7-9669-4bcd-be53-1997cd99ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babf3294-ccb1-41e0-953a-0fa371b25901', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3d0002-f45a-47eb-8b24-8406f159e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:04 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Volume volume-babf3294-ccb1-41e0-953a-0fa371b25901 (babf3294-ccb1-41e0-953a-0fa371b25901): created successfully
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3d0002-f45a-47eb-8b24-8406f159e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Flow 'volume_create_manager' (75e37d34-0fc0-44bf-b90b-824dd0d7d144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-831ef0c7-ba91-49dd-b9e7-0aa0ff98ba77 tempest-VolumesTransfersTest-524581942 None] Created volume successfully.
Sep 17 07:43:06 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3f771d3b-d2a5-4d17-8130-751d1ee827b7 tempest-VolumesTransfersTest-607428627 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:06 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3f771d3b-d2a5-4d17-8130-751d1ee827b7 tempest-VolumesTransfersTest-607428627 None] Transfer volume completed successfully.
Sep 17 07:43:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Acquiring lock "cinder-babf3294-ccb1-41e0-953a-0fa371b25901-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-babf3294-ccb1-41e0-953a-0fa371b25901-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=60,cinder:DELETE=7,cinder:SELECT=42,cinder:INSERT=25 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=64,cinder:INSERT=7,cinder:UPDATE=74,cinder:DELETE=5 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:43:08 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Acquiring lock "cinder-quobyte-babf3294-ccb1-41e0-953a-0fa371b25901" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-quobyte-babf3294-ccb1-41e0-953a-0fa371b25901" acquired by "delete_volume" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[664518bf-86ae-43e6-8f21-f8b560a6360a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:43:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:08 devstack quobyte-client[83654]: System call of process 92170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:43:08 devstack quobyte-client[83654]: System call of process 92170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901" returned: 0 in 0.992s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-babf3294-ccb1-41e0-953a-0fa371b25901" returned: 0 in 0.160s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Flow 'volume_create_manager' (98d9811f-8b0b-4dc2-a07e-7c198416ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8c01b4-ba34-4f5d-a02b-6b8ad229b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-quobyte-babf3294-ccb1-41e0-953a-0fa371b25901" released by "delete_volume" :: held 1.664s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8c01b4-ba34-4f5d-a02b-6b8ad229b53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-802170461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16388142-a080-43e3-8451-00c0aeda4586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8dd175049348dda587ed46cdf51238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:09Z,use_quota=True,user_id='9b29b01651eb48d09bf4edc8372d4ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c20eb3-05cd-4e03-b28a-5a93dc4bd621),volume_type_id=b0c20eb3-05cd-4e03-b28a-5a93dc4bd621)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8eb7f7-406d-4c26-a3b6-943a568ee024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8eb7f7-406d-4c26-a3b6-943a568ee024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de8b332-9747-4735-9cb3-20e30921587e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de8b332-9747-4735-9cb3-20e30921587e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16388142-a080-43e3-8451-00c0aeda4586', 'volume_name': 'volume-16388142-a080-43e3-8451-00c0aeda4586', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9f46b2-5777-46fd-80c1-4abb2555de77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9f46b2-5777-46fd-80c1-4abb2555de77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b24c51-8377-417d-9a19-091f5d58bd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:09 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Volume 16388142-a080-43e3-8451-00c0aeda4586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16388142-a080-43e3-8451-00c0aeda4586', 'volume_size': 1}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-802170461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16388142-a080-43e3-8451-00c0aeda4586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8dd175049348dda587ed46cdf51238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:09Z,use_quota=True,user_id='9b29b01651eb48d09bf4edc8372d4ddc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c20eb3-05cd-4e03-b28a-5a93dc4bd621),volume_type_id=b0c20eb3-05cd-4e03-b28a-5a93dc4bd621)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Creating volume 16388142-a080-43e3-8451-00c0aeda4586 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:43:09 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:43:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:10 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=56, name=volume-16388142-a080-43e3-8451-00c0aeda4586, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586 1073741824" returned: 0 in 0.463s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Created reservations ['68065e19-5a05-4a59-a2a3-404e1c8f5eb5', '70b471ae-10a9-4dfd-9d6c-29e083038889', 'd8263a21-87af-477d-8e43-62b10142b81d', 'b4373f38-a8fe-4138-be02-64254f7398a1'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586" returned: 0 in 0.429s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] <== create_volume: return (941ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b24c51-8377-417d-9a19-091f5d58bd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16388142-a080-43e3-8451-00c0aeda4586', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2ca61e-c43a-4ba3-8f0e-cb7dd304870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:11 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Volume volume-16388142-a080-43e3-8451-00c0aeda4586 (16388142-a080-43e3-8451-00c0aeda4586): created successfully
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2ca61e-c43a-4ba3-8f0e-cb7dd304870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Flow 'volume_create_manager' (98d9811f-8b0b-4dc2-a07e-7c198416ab45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-94cf1267-007f-4cc9-955f-f1a8561f2bc0 tempest-VolumeTypesAccessTest-470588471 None] Created volume successfully.
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.284s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:11 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Deleted volume successfully.
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2193a201-39d2-4fac-8d4d-3f894c410eb2 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-babf3294-ccb1-41e0-953a-0fa371b25901-delete_volume" released by "delete_volume" :: held 4.241s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Acquiring lock "cinder-16388142-a080-43e3-8451-00c0aeda4586-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Lock "cinder-16388142-a080-43e3-8451-00c0aeda4586-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Acquiring lock "cinder-quobyte-16388142-a080-43e3-8451-00c0aeda4586" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Lock "cinder-quobyte-16388142-a080-43e3-8451-00c0aeda4586" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[919331f2-8de1-45ed-9793-a02057dc1fdd]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:43:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:13 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Flow 'volume_create_manager' (01c168b8-c08b-487e-b9bb-ebea22595383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb57c96e-4eb5-4335-99b2-46103a99562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb57c96e-4eb5-4335-99b2-46103a99562b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1397193407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803ce572-33bc-47c0-89ca-8ab1a9c019ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7453a7db81b4de299b2b0fdf5154ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:13Z,use_quota=True,user_id='8e2cb87e96b74e62a7877cc0f765147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2b9ea2-5727-41c8-ba54-17d6deb7c1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2b9ea2-5727-41c8-ba54-17d6deb7c1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b525f044-d03f-4688-b52a-7dc11613aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b525f044-d03f-4688-b52a-7dc11613aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803ce572-33bc-47c0-89ca-8ab1a9c019ce', 'volume_name': 'volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c95f93f-a848-4ed9-9108-88751aaac13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c95f93f-a848-4ed9-9108-88751aaac13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2009ab7e-de5b-48b5-a81d-28b1d8a2d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:13 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Volume 803ce572-33bc-47c0-89ca-8ab1a9c019ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce', 'volume_size': 1}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1397193407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803ce572-33bc-47c0-89ca-8ab1a9c019ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7453a7db81b4de299b2b0fdf5154ce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:13Z,use_quota=True,user_id='8e2cb87e96b74e62a7877cc0f765147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Creating volume 803ce572-33bc-47c0-89ca-8ab1a9c019ce {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:43:13 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586" returned: 0 in 1.079s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:14 devstack quobyte-client[83654]: System call of process 92199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:43:14 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=57, name=volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-16388142-a080-43e3-8451-00c0aeda4586" returned: 0 in 0.177s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Lock "cinder-quobyte-16388142-a080-43e3-8451-00c0aeda4586" released by "delete_volume" :: held 1.510s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce 1073741824" returned: 0 in 0.670s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce" returned: 0 in 0.273s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] <== create_volume: return (985ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:43:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:14 devstack cinder-volume[83645]: WARNING cinder.quota [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-735551360 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-735551360, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:43:14 devstack cinder-volume[83645]: WARNING cinder.quota [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-735551360 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-735551360, it is now deprecated. Please use the default quota class for default quota.
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Created reservations ['50cb1dce-7b8b-49fc-8e06-473ed9c27386', 'd9abb840-c4d0-448d-9e22-b8f42699dc4a', '3108d57b-860e-473f-baf3-6a7d74ce3f86', 'a9b5aaaa-8775-4f6d-b25e-69619249bb22'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2009ab7e-de5b-48b5-a81d-28b1d8a2d59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5a6fe1-fb80-4f68-9156-0762d4251f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:15 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Volume volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce (803ce572-33bc-47c0-89ca-8ab1a9c019ce): created successfully
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5a6fe1-fb80-4f68-9156-0762d4251f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Flow 'volume_create_manager' (01c168b8-c08b-487e-b9bb-ebea22595383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-adde662e-2417-44d3-80a1-1f30055d8e3d tempest-VolumesTransfersTest-524581942 None] Created volume successfully.
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.174s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:15 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Deleted volume successfully.
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3095b0d-f732-4f08-a0d6-bcd251e92f63 tempest-VolumeTypesAccessTest-470588471 None] Lock "cinder-16388142-a080-43e3-8451-00c0aeda4586-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Acquiring lock "cinder-803ce572-33bc-47c0-89ca-8ab1a9c019ce-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-803ce572-33bc-47c0-89ca-8ab1a9c019ce-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:16 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Acquiring lock "cinder-quobyte-803ce572-33bc-47c0-89ca-8ab1a9c019ce" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-quobyte-803ce572-33bc-47c0-89ca-8ab1a9c019ce" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[292b8106-8699-4ef3-9399-9b9fd203bdfa]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:43:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce" returned: 0 in 0.698s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-803ce572-33bc-47c0-89ca-8ab1a9c019ce" returned: 0 in 0.263s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-quobyte-803ce572-33bc-47c0-89ca-8ab1a9c019ce" released by "delete_volume" :: held 1.152s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:17 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Created reservations ['1e484bf9-a0cf-42db-b924-f19e35959282', 'eb648256-42ec-4b43-90fe-6590ed41e91f', 'fe9ee737-e705-4b15-8f87-a5d65fe2967b', 'cfe173f1-44a8-468b-adb3-d02424270501'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.300s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:18 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Deleted volume successfully.
Sep 17 07:43:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e062484-e045-46b6-8c12-c1344fd2a1e1 tempest-VolumesTransfersTest-1804494729 None] Lock "cinder-803ce572-33bc-47c0-89ca-8ab1a9c019ce-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:28 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=19,cinder:INSERT=10,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:43:29 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=34,cinder:SELECT=14,cinder:DELETE=4,cinder:INSERT=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:43:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:35 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:43:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Flow 'volume_create_manager' (3ca504a3-1848-4d5d-83a9-242e630fbda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de4f4de-dd69-499b-ad50-979d7fc142ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de4f4de-dd69-499b-ad50-979d7fc142ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-58298474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a29adfe001442fcb514734e2773062d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:35Z,use_quota=True,user_id='bfbe046473674e94bcbca01b0262b18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aac0ee-2681-473f-bc3e-1087845a776c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aac0ee-2681-473f-bc3e-1087845a776c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801c6b71-aca7-4ae5-89a1-c7287e2589e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801c6b71-aca7-4ae5-89a1-c7287e2589e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef', 'volume_name': 'volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafeafb1-4cb2-453e-8d3e-f7cf138a72ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafeafb1-4cb2-453e-8d3e-f7cf138a72ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb01de-be1b-49f0-81a8-fe4d8edce297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Volume 0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef', 'volume_size': 1}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-58298474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a29adfe001442fcb514734e2773062d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:35Z,use_quota=True,user_id='bfbe046473674e94bcbca01b0262b18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Creating volume 0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:43:36 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:36 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=58, name=volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef 1073741824" returned: 0 in 0.598s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef" returned: 0 in 0.305s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] <== create_volume: return (1344ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cb01de-be1b-49f0-81a8-fe4d8edce297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb6e42f-514a-497e-adca-fe04f5214699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:37 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Volume volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef (0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef): created successfully
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb6e42f-514a-497e-adca-fe04f5214699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Flow 'volume_create_manager' (3ca504a3-1848-4d5d-83a9-242e630fbda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-71a3faa3-a71f-4252-9aac-da5106b74ce3 tempest-VolumesTransfersV357Test-449594776 None] Created volume successfully.
Sep 17 07:43:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3b071244-a9bb-4b73-86c9-69c32e50c6bb tempest-VolumesTransfersV357Test-1867128219 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:40 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3b071244-a9bb-4b73-86c9-69c32e50c6bb tempest-VolumesTransfersV357Test-1867128219 None] Transfer volume completed successfully.
Sep 17 07:43:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Acquiring lock "cinder-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Acquiring lock "cinder-quobyte-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-quobyte-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:42 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a9ac2-caeb-417a-937c-61165382931b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:43:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef" returned: 0 in 0.628s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef" returned: 0 in 0.169s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-quobyte-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef" released by "delete_volume" :: held 1.141s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Created reservations ['65248b11-ba20-4c50-8d58-b68047fb7fe3', '085e1809-686d-4430-b7af-b6f8914149e0', '0d15e8ce-cdec-4c6c-b627-5606910308c6', '82b9737d-2de7-4163-af16-fb035dac2dda'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.144s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:44 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Deleted volume successfully.
Sep 17 07:43:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5054d235-1273-4a31-878b-d2c7a3171c9c tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-0fdf203d-d3af-4cd4-b1c0-e0d92979e2ef-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:45 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:45 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:43:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Flow 'volume_create_manager' (ce137679-f65c-4040-a93a-18d34208624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5fefa9-817e-457f-a5ea-3a424d9fb199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5fefa9-817e-457f-a5ea-3a424d9fb199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2132282762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23872f30-9277-48e2-9911-10e609e6a0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a29adfe001442fcb514734e2773062d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:46Z,use_quota=True,user_id='bfbe046473674e94bcbca01b0262b18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f84dff-78c5-45ce-b628-c7990234e33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f84dff-78c5-45ce-b628-c7990234e33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29c9c29-791d-49be-b83e-c8fd11e903e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f29c9c29-791d-49be-b83e-c8fd11e903e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23872f30-9277-48e2-9911-10e609e6a0b2', 'volume_name': 'volume-23872f30-9277-48e2-9911-10e609e6a0b2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a15004-52ff-45de-9e5c-3547ba32fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a15004-52ff-45de-9e5c-3547ba32fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b45082-26b7-42b2-adbb-7f52aa934634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:46 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Volume 23872f30-9277-48e2-9911-10e609e6a0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23872f30-9277-48e2-9911-10e609e6a0b2', 'volume_size': 1}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2132282762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23872f30-9277-48e2-9911-10e609e6a0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a29adfe001442fcb514734e2773062d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:46Z,use_quota=True,user_id='bfbe046473674e94bcbca01b0262b18f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Creating volume 23872f30-9277-48e2-9911-10e609e6a0b2 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:43:46 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:46 devstack quobyte-client[83654]: System call of process 92327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:46 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=59, name=volume-23872f30-9277-48e2-9911-10e609e6a0b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2 1073741824" returned: 0 in 0.467s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.326s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2" returned: 0 in 0.240s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:43:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b45082-26b7-42b2-adbb-7f52aa934634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23872f30-9277-48e2-9911-10e609e6a0b2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a800ee61-661b-417f-ae0d-89b2714f384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Volume volume-23872f30-9277-48e2-9911-10e609e6a0b2 (23872f30-9277-48e2-9911-10e609e6a0b2): created successfully
Sep 17 07:43:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a800ee61-661b-417f-ae0d-89b2714f384c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Flow 'volume_create_manager' (ce137679-f65c-4040-a93a-18d34208624f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:47 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-db60ffc6-ad92-4116-a9ac-155521a3b93f tempest-VolumesTransfersV357Test-449594776 None] Created volume successfully.
Sep 17 07:43:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Flow 'volume_create_manager' (12a2b241-72cb-47fd-bec3-0eb2c9cd4948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ef750a-90da-481e-865c-02fd5b151531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ef750a-90da-481e-865c-02fd5b151531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1117425582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7051d7a1-68a3-4897-970f-f333a84260cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfa3233b3d645a3aa65e1a350acb589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:48Z,use_quota=True,user_id='e2c2eedd4dba44dbba9f4fb851848a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebf5055-7bf9-48a6-833a-b0a09e1215c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebf5055-7bf9-48a6-833a-b0a09e1215c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a186ee15-ec45-4c0d-bc26-faf5987f55b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a186ee15-ec45-4c0d-bc26-faf5987f55b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7051d7a1-68a3-4897-970f-f333a84260cc', 'volume_name': 'volume-7051d7a1-68a3-4897-970f-f333a84260cc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fc5c48-d23e-4b01-b89c-dc1229555e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fc5c48-d23e-4b01-b89c-dc1229555e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b14519e-8ffe-421e-9d89-902036c983ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:48 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Volume 7051d7a1-68a3-4897-970f-f333a84260cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7051d7a1-68a3-4897-970f-f333a84260cc', 'volume_size': 1}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1117425582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7051d7a1-68a3-4897-970f-f333a84260cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfa3233b3d645a3aa65e1a350acb589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:48Z,use_quota=True,user_id='e2c2eedd4dba44dbba9f4fb851848a18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Creating volume 7051d7a1-68a3-4897-970f-f333a84260cc {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:43:48 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:43:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:48 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=60, name=volume-7051d7a1-68a3-4897-970f-f333a84260cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Acquiring lock "cinder-23872f30-9277-48e2-9911-10e609e6a0b2-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc 1073741824" returned: 0 in 0.724s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-23872f30-9277-48e2-9911-10e609e6a0b2-delete_volume" acquired by "delete_volume" :: waited 0.480s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc" returned: 0 in 0.492s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] <== create_volume: return (1258ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:43:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b14519e-8ffe-421e-9d89-902036c983ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7051d7a1-68a3-4897-970f-f333a84260cc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acb2c48-12f5-4a93-ab53-bb816db0fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:43:50 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Volume volume-7051d7a1-68a3-4897-970f-f333a84260cc (7051d7a1-68a3-4897-970f-f333a84260cc): created successfully
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acb2c48-12f5-4a93-ab53-bb816db0fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Flow 'volume_create_manager' (12a2b241-72cb-47fd-bec3-0eb2c9cd4948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:43:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Acquiring lock "cinder-quobyte-23872f30-9277-48e2-9911-10e609e6a0b2" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-quobyte-23872f30-9277-48e2-9911-10e609e6a0b2" acquired by "delete_volume" :: waited 0.041s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-064d04ba-bf78-4a45-902a-3d57d7fcc572 tempest-VolumesMetadataTest-1117460532 None] Created volume successfully.
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb151ca-84ba-438b-befc-74c59b11840a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:43:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:51 devstack quobyte-client[83654]: System call of process 92366 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:43:51 devstack quobyte-client[83654]: System call of process 92366 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:43:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2" returned: 0 in 0.813s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-23872f30-9277-48e2-9911-10e609e6a0b2" returned: 0 in 0.171s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-quobyte-23872f30-9277-48e2-9911-10e609e6a0b2" released by "delete_volume" :: held 1.364s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:51 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Created reservations ['b857a318-ad38-430c-a0a0-6066b19bd954', '969b54bf-3e85-4a6e-9a9c-0143c5aa2b25', 'a03d1899-5ff7-457b-b76c-a8b24d551930', 'ad17f935-880b-4724-bb53-936cd78a0594'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Acquiring lock "cinder-7051d7a1-68a3-4897-970f-f333a84260cc-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.370s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:52 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:52 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Deleted volume successfully.
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Lock "cinder-7051d7a1-68a3-4897-970f-f333a84260cc-delete_volume" acquired by "delete_volume" :: waited 0.339s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1b369605-5c82-4311-a865-2fb6b25378f1 tempest-VolumesTransfersV357Test-40556298 None] Lock "cinder-23872f30-9277-48e2-9911-10e609e6a0b2-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Acquiring lock "cinder-quobyte-7051d7a1-68a3-4897-970f-f333a84260cc" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Lock "cinder-quobyte-7051d7a1-68a3-4897-970f-f333a84260cc" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5aebc1-7189-4a70-a38d-41115c94db76]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc" returned: 0 in 0.545s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7051d7a1-68a3-4897-970f-f333a84260cc" returned: 0 in 0.206s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Lock "cinder-quobyte-7051d7a1-68a3-4897-970f-f333a84260cc" released by "delete_volume" :: held 0.957s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:43:54 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Created reservations ['afbabc17-1067-4707-9dd7-e346695f9566', 'ecdb86e3-ad82-4a23-877c-f86e755fbfeb', '7605d678-452a-4d6e-a8ce-4557fe6a8224', '15f63ea8-ed2d-48df-99af-a2a481b313ea'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.338s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:43:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Deleted volume successfully.
Sep 17 07:43:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3b8d7b-c9df-47f9-8fbf-e5f643c4bca6 tempest-VolumesMetadataTest-1117460532 None] Lock "cinder-7051d7a1-68a3-4897-970f-f333a84260cc-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Flow 'volume_create_manager' (5b20cc95-3312-42b0-b275-f97d8df0bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70452dc-6a3a-49db-a844-b4c319ca0376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70452dc-6a3a-49db-a844-b4c319ca0376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2129096900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41174fdb-8983-473f-a2d7-f842af535ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471dff9164aa4b62a2051b3c1bbe703c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:04Z,use_quota=True,user_id='c8fda222f4fa4bdf87020c6038e970a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b18a7bd-621c-4ebe-8764-60412542c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b18a7bd-621c-4ebe-8764-60412542c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc65826-58b0-496b-8a78-ed64fa381a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc65826-58b0-496b-8a78-ed64fa381a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41174fdb-8983-473f-a2d7-f842af535ea6', 'volume_name': 'volume-41174fdb-8983-473f-a2d7-f842af535ea6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7927d5e8-343d-46fe-9aa9-d273936ee5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7927d5e8-343d-46fe-9aa9-d273936ee5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06ca3fd-735f-4e55-8553-c5cc8e74dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:04 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Volume 41174fdb-8983-473f-a2d7-f842af535ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41174fdb-8983-473f-a2d7-f842af535ea6', 'volume_size': 1}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2129096900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41174fdb-8983-473f-a2d7-f842af535ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471dff9164aa4b62a2051b3c1bbe703c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:04Z,use_quota=True,user_id='c8fda222f4fa4bdf87020c6038e970a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Creating volume 41174fdb-8983-473f-a2d7-f842af535ea6 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:04 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:05 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=61, name=volume-41174fdb-8983-473f-a2d7-f842af535ea6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6 1073741824" returned: 0 in 0.662s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6" returned: 0 in 0.164s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] <== create_volume: return (934ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f06ca3fd-735f-4e55-8553-c5cc8e74dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41174fdb-8983-473f-a2d7-f842af535ea6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b772e4f1-a532-4363-865b-640011bb0c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:06 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Volume volume-41174fdb-8983-473f-a2d7-f842af535ea6 (41174fdb-8983-473f-a2d7-f842af535ea6): created successfully
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b772e4f1-a532-4363-865b-640011bb0c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Flow 'volume_create_manager' (5b20cc95-3312-42b0-b275-f97d8df0bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:06 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Flow 'volume_create_manager' (9ff7bb68-a9f7-4587-a3f9-d92c65fdd36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a902236-c7d7-4e16-8213-20f981a1ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:06 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1416eab3-de16-4a97-adaa-5ef6ff646e1b tempest-VolumesTransfersV355Test-968741467 None] Created volume successfully.
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a902236-c7d7-4e16-8213-20f981a1ae27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-691675180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db4ae61-2aca-4e96-abd7-ed5384305850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3a9e5a3fe4bc1bc12ccb43ee786ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:06Z,use_quota=True,user_id='aa56c5d8a55d42e19b11c6e62e612d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87db55f-2222-47e7-9166-0a96dcff90b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87db55f-2222-47e7-9166-0a96dcff90b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca15719-c2ea-4c2b-8446-e9e9b869c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca15719-c2ea-4c2b-8446-e9e9b869c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6db4ae61-2aca-4e96-abd7-ed5384305850', 'volume_name': 'volume-6db4ae61-2aca-4e96-abd7-ed5384305850', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c8625cca0>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e30539-f499-4be2-b666-da4e4531007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4e30539-f499-4be2-b666-da4e4531007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0b936d-3230-4c2a-ab6d-7a603c2fca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:06 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Volume 6db4ae61-2aca-4e96-abd7-ed5384305850: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6db4ae61-2aca-4e96-abd7-ed5384305850', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c8625cca0>}
Sep 17 07:44:06 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Cloning 6db4ae61-2aca-4e96-abd7-ed5384305850 from image f78f338c-82d6-4001-a9f8-06473b1187dc  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 07:44:07 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 07:44:07 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 07:44:07 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d7c922-c662-4348-8275-db1036707b5e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:08 devstack sudo[92397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD
Sep 17 07:44:08 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:44:08 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7f4dde9e-66f0-462b-8274-266f9b9b473a tempest-VolumesTransfersV355Test-496536539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:08 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7f4dde9e-66f0-462b-8274-266f9b9b473a tempest-VolumesTransfersV355Test-496536539 None] Transfer volume completed successfully.
Sep 17 07:44:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Acquiring lock "cinder-41174fdb-8983-473f-a2d7-f842af535ea6-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-41174fdb-8983-473f-a2d7-f842af535ea6-delete_volume" acquired by "delete_volume" :: waited 0.375s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Acquiring lock "cinder-quobyte-41174fdb-8983-473f-a2d7-f842af535ea6" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-quobyte-41174fdb-8983-473f-a2d7-f842af535ea6" acquired by "delete_volume" :: waited 0.030s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ef616b-4dbe-4e20-ab23-070cc56df610]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:10 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD" returned: 0 in 3.215s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc is fetched for user aa56c5d8a55d42e19b11c6e62e612d27. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 07:44:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6" returned: 0 in 0.814s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-41174fdb-8983-473f-a2d7-f842af535ea6" returned: 0 in 0.186s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-quobyte-41174fdb-8983-473f-a2d7-f842af535ea6" released by "delete_volume" :: held 1.387s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:11 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65770ee-adb1-4b06-a64f-5f7201d5d3a9]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Created reservations ['1a37b87c-ca95-45a4-9f7f-7f379a431f45', '714f4149-99be-410f-98d2-4214ade42533', 'acd727b6-9982-41d7-816f-1ec7d2744c4c', '896503e4-b7e8-40a2-9db5-94b118743e5f'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:44:12 devstack sudo[92406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD
Sep 17 07:44:12 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.190s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:12 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:44:12 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Deleted volume successfully.
Sep 17 07:44:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-400ea0cb-939d-4c0a-99b8-e5f4839f5028 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-41174fdb-8983-473f-a2d7-f842af535ea6-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:14 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Flow 'volume_create_manager' (ac5ec17d-2986-454a-bc64-dae3d7509ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce0fe8b-1f59-47ee-a7a2-e8eee138a8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce0fe8b-1f59-47ee-a7a2-e8eee138a8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1622792223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1e27cf-fcf9-4a66-8d09-76d4aa945cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471dff9164aa4b62a2051b3c1bbe703c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:14Z,use_quota=True,user_id='c8fda222f4fa4bdf87020c6038e970a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebf44a5-89f0-468e-bfdb-ae417ac99149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebf44a5-89f0-468e-bfdb-ae417ac99149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3c384b-035f-4a4d-993c-ea0484cfe1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3c384b-035f-4a4d-993c-ea0484cfe1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1e27cf-fcf9-4a66-8d09-76d4aa945cae', 'volume_name': 'volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664547c8-29cc-4eab-94f7-669ff9601bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664547c8-29cc-4eab-94f7-669ff9601bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a609dce-f64f-4f50-b114-e648bbe68eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:14 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Volume 6d1e27cf-fcf9-4a66-8d09-76d4aa945cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae', 'volume_size': 1}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1622792223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1e27cf-fcf9-4a66-8d09-76d4aa945cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471dff9164aa4b62a2051b3c1bbe703c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:14Z,use_quota=True,user_id='c8fda222f4fa4bdf87020c6038e970a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Creating volume 6d1e27cf-fcf9-4a66-8d09-76d4aa945cae {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:14 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:14 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=62, name=volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:14 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD" returned: 0 in 3.355s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae 1073741824" returned: 0 in 0.605s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae" returned: 0 in 0.125s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] <== create_volume: return (775ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-691675180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db4ae61-2aca-4e96-abd7-ed5384305850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3a9e5a3fe4bc1bc12ccb43ee786ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:06Z,use_quota=True,user_id='aa56c5d8a55d42e19b11c6e62e612d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Creating volume 6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:15 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:15 devstack quobyte-client[83654]: System call of process 92417 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:15 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=63, name=volume-6db4ae61-2aca-4e96-abd7-ed5384305850, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a609dce-f64f-4f50-b114-e648bbe68eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec82489e-d563-445f-b2a5-be0054474b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:15 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Volume volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae (6d1e27cf-fcf9-4a66-8d09-76d4aa945cae): created successfully
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec82489e-d563-445f-b2a5-be0054474b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Flow 'volume_create_manager' (ac5ec17d-2986-454a-bc64-dae3d7509ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 1073741824" returned: 0 in 0.486s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 0 in 0.150s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] <== create_volume: return (720ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:16 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6e56f6cf-9ffd-465d-8571-de955f2d844a tempest-VolumesTransfersV355Test-968741467 None] Created volume successfully.
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Attempting download of f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 6db4ae61-2aca-4e96-abd7-ed5384305850. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7468bf-4f40-489e-bf7c-5ea8f9f80393]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_cmns7pv3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Acquiring lock "cinder-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_cmns7pv3" returned: 0 in 0.602s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_cmns7pv3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Acquiring lock "cinder-quobyte-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-quobyte-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae" acquired by "delete_volume" :: waited 0.076s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756433d-2cef-47d8-b580-ebdaecd46b23]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_cmns7pv3" returned: 1 in 0.613s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_cmns7pv3' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc84792-a340-444a-a510-72676e33ad73]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae" returned: 0 in 0.560s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae" returned: 0 in 0.131s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD" returned: 0 in 0.702s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] f78f338c-82d6-4001-a9f8-06473b1187dc was qcow2, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:18 devstack quobyte-client[83654]: System call of process 92433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-quobyte-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae" released by "delete_volume" :: held 1.026s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:18 devstack quobyte-client[83654]: System call of process 92433 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=63, name=volume-6db4ae61-2aca-4e96-abd7-ed5384305850, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Created reservations ['22346a34-1115-48b4-b5bf-c066ef2a60e1', 'f9988b75-8c33-478a-ab2c-c605b4f619b4', 'edac8ebf-0dc3-4357-8920-6a245c02c639', '31968677-877e-4033-93ec-d476a5d6b139'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.304s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:44:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Deleted volume successfully.
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 0 in 1.327s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_ihfel815devstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:44:19 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Converted 112.00 MB image at 84.03 MB/s
Sep 17 07:44:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e95de57-819a-4d29-ada6-0c2bead9b134 tempest-VolumesTransfersV355Test-1370948835 None] Lock "cinder-6d1e27cf-fcf9-4a66-8d09-76d4aa945cae-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 1G" returned: 0 in 0.197s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:20 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d0cba-cec7-48cd-8b96-b20e3dafc963]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 0 in 0.536s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 1 in 0.376s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Downloaded image f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 6db4ae61-2aca-4e96-abd7-ed5384305850 successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc for user aa56c5d8a55d42e19b11c6e62e612d27 is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Marking volume 6db4ae61-2aca-4e96-abd7-ed5384305850 as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Copying metadata from image f78f338c-82d6-4001-a9f8-06473b1187dc to 6db4ae61-2aca-4e96-abd7-ed5384305850. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Creating volume glance metadata for volume 6db4ae61-2aca-4e96-abd7-ed5384305850 backed by image f78f338c-82d6-4001-a9f8-06473b1187dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d0b936d-3230-4c2a-ab6d-7a603c2fca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db4ae61-2aca-4e96-abd7-ed5384305850', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c8625cca0>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0759b67b-919e-4b4a-9e77-b4d1c160139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:21 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Volume volume-6db4ae61-2aca-4e96-abd7-ed5384305850 (6db4ae61-2aca-4e96-abd7-ed5384305850): created successfully
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0759b67b-919e-4b4a-9e77-b4d1c160139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Flow 'volume_create_manager' (9ff7bb68-a9f7-4587-a3f9-d92c65fdd36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-55213979-772d-4680-bba8-d6293cd7465c tempest-VolumesExtendTest-135405602 None] Created volume successfully.
Sep 17 07:44:22 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:22 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a9b128-fcc8-4d3e-be04-bff4467acff7]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 0 in 0.459s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 1 in 0.524s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:44:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 2G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:23 devstack quobyte-client[83654]: System call of process 92463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 2G" returned: 0 in 0.183s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.344s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:23 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-527675c8-5afe-4843-abf9-1069c1f67fcc tempest-VolumesExtendTest-135405602 None] Extend volume completed successfully.
Sep 17 07:44:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-6db4ae61-2aca-4e96-abd7-ed5384305850-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Lock "cinder-6db4ae61-2aca-4e96-abd7-ed5384305850-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-quobyte-6db4ae61-2aca-4e96-abd7-ed5384305850" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-6db4ae61-2aca-4e96-abd7-ed5384305850" acquired by "delete_volume" :: waited 0.018s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4aa3a9-e404-4e2f-8fc7-457bcef24b94]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 0 in 0.682s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 1 in 0.540s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6db4ae61-2aca-4e96-abd7-ed5384305850" returned: 0 in 0.122s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-6db4ae61-2aca-4e96-abd7-ed5384305850" released by "delete_volume" :: held 1.684s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Created reservations ['870d130d-4b41-4202-a33b-907ff3aa9a5c', 'b610ec47-26ea-4263-9b62-9f139fdafbd1', '1706dbe4-9f86-49b6-834e-001cc75897ec', 'ca061d02-a68c-44bc-81fc-45d745636254'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.132s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:44:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Deleted volume successfully.
Sep 17 07:44:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-094cfddc-225f-4229-a1a7-383099c11e8a tempest-VolumesExtendTest-135405602 None] Lock "cinder-6db4ae61-2aca-4e96-abd7-ed5384305850-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=46,cinder:UPDATE=49,cinder:DELETE=8,cinder:INSERT=23 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=81,cinder:SELECT=48,cinder:INSERT=14,cinder:DELETE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:44:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Flow 'volume_create_manager' (9fd450d4-8c9b-47c2-8aab-37868c8d217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91510442-a314-4b8e-aeda-296d45f534b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91510442-a314-4b8e-aeda-296d45f534b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-966199743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da654d9-9bc8-413c-bf35-cae5904f1d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3a9e5a3fe4bc1bc12ccb43ee786ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:29Z,use_quota=True,user_id='aa56c5d8a55d42e19b11c6e62e612d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7e0b5f-a9c3-4eea-bbc3-6212726e158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7e0b5f-a9c3-4eea-bbc3-6212726e158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ce61a5-21bf-4a6c-846c-e4c65ae2b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ce61a5-21bf-4a6c-846c-e4c65ae2b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da654d9-9bc8-413c-bf35-cae5904f1d1a', 'volume_name': 'volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a47b47-a73e-4c96-902e-ebbe634e7e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a47b47-a73e-4c96-902e-ebbe634e7e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8808ab53-f8dc-48b5-b629-25d7042e7795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Volume 1da654d9-9bc8-413c-bf35-cae5904f1d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a', 'volume_size': 1}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-966199743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da654d9-9bc8-413c-bf35-cae5904f1d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de3a9e5a3fe4bc1bc12ccb43ee786ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:29Z,use_quota=True,user_id='aa56c5d8a55d42e19b11c6e62e612d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Creating volume 1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:29 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:29 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=64, name=volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a 1073741824" returned: 0 in 0.672s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Flow 'volume_create_manager' (dee66293-d991-4e21-9b1b-5146ed1345cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1be888-b355-4b4d-b69c-d017ef0db600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a" returned: 0 in 0.455s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] <== create_volume: return (1158ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1be888-b355-4b4d-b69c-d017ef0db600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-990186072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00e02e5-4f0d-4590-92e2-363df0d4e6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4354ce4e414b1783b7cd0ea2c02044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:30Z,use_quota=True,user_id='cf24cdf4fbb547079f15dded6e049cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224a1534-2ed5-4faf-9516-9dbe3374d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224a1534-2ed5-4faf-9516-9dbe3374d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0863d6bb-653a-4eec-8d65-a6a9e8d2e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0863d6bb-653a-4eec-8d65-a6a9e8d2e63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00e02e5-4f0d-4590-92e2-363df0d4e6bc', 'volume_name': 'volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc', 'volume_size': 2}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5414900c-e467-41b6-a8b4-effc0a95d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5414900c-e467-41b6-a8b4-effc0a95d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ca64b5-f2a5-46d8-94a0-11b318b85bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Volume b00e02e5-4f0d-4590-92e2-363df0d4e6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc', 'volume_size': 2}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-990186072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00e02e5-4f0d-4590-92e2-363df0d4e6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4354ce4e414b1783b7cd0ea2c02044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:30Z,use_quota=True,user_id='cf24cdf4fbb547079f15dded6e049cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Creating volume b00e02e5-4f0d-4590-92e2-363df0d4e6bc {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:30 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc 2147483648 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:30 devstack quobyte-client[83654]: System call of process 92490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:31 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=65, name=volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8808ab53-f8dc-48b5-b629-25d7042e7795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fb362e-38db-4397-b9b1-1d9a153e529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:31 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Volume volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a (1da654d9-9bc8-413c-bf35-cae5904f1d1a): created successfully
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8fb362e-38db-4397-b9b1-1d9a153e529a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Flow 'volume_create_manager' (9fd450d4-8c9b-47c2-8aab-37868c8d217c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-126aeae0-d460-49fb-8657-eb77250d1d35 tempest-VolumesExtendTest-135405602 None] Created volume successfully.
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc 2147483648" returned: 0 in 0.695s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc" returned: 0 in 0.141s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ca64b5-f2a5-46d8-94a0-11b318b85bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc', 'volume_size': 2}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab13b2e7-2d4a-4d77-b9bc-7c351e8b207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:32 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Volume volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc (b00e02e5-4f0d-4590-92e2-363df0d4e6bc): created successfully
Sep 17 07:44:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab13b2e7-2d4a-4d77-b9bc-7c351e8b207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Flow 'volume_create_manager' (dee66293-d991-4e21-9b1b-5146ed1345cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-80c28986-a0bd-4b38-b988-65025e8df5b0 tempest-VolumesCloneNegativeTest-244418523 None] Created volume successfully.
Sep 17 07:44:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Creating offline snapshot 2645d103-932f-4a0a-aa85-3351654f21b2 of volume 1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfd7f1c-4879-40cc-91ca-a22156a268ee]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:33 devstack quobyte-client[83654]: System call of process 92498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:33 devstack quobyte-client[83654]: System call of process 92498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Acquiring lock "cinder-b00e02e5-4f0d-4590-92e2-363df0d4e6bc-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a" returned: 0 in 0.710s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Lock "cinder-b00e02e5-4f0d-4590-92e2-363df0d4e6bc-delete_volume" acquired by "delete_volume" :: waited 0.213s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:34 devstack quobyte-client[83654]: System call of process 92501 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:34 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=66, name=volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 1G" returned: 0 in 0.452s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:34 devstack quobyte-client[83654]: System call of process 92504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:34 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Acquiring lock "cinder-quobyte-b00e02e5-4f0d-4590-92e2-363df0d4e6bc" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "qemu-img rebase -u -b volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2" returned: 0 in 0.506s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:44:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Lock "cinder-quobyte-b00e02e5-4f0d-4590-92e2-363df0d4e6bc" acquired by "delete_volume" :: waited 0.266s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[199493ca-d6dc-4939-bb1d-8a3fb1f8524d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2" returned: 0 in 0.293s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2" returned: 0 in 0.169s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.info" returned: 0 in 0.142s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.info" returned: 0 in 0.147s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc" returned: 0 in 0.961s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b00e02e5-4f0d-4590-92e2-363df0d4e6bc" returned: 0 in 0.249s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Lock "cinder-quobyte-b00e02e5-4f0d-4590-92e2-363df0d4e6bc" released by "delete_volume" :: held 1.369s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ddfd70a9-58aa-469a-8f81-8ae89d4e07d8 tempest-VolumesExtendTest-135405602 None] Create snapshot completed successfully
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Created reservations ['c38cb474-cc70-483f-8490-c9627b1deb6b', 'bdef507a-4e42-4154-b46a-76876ff13322', '39156b2d-47b3-49e2-9183-b03f53f6725c', 'd7da997e-7561-470b-9048-86cd5a35e40c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.102s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:36 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:44:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Deleted volume successfully.
Sep 17 07:44:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7b3e7b38-a433-4895-b454-e604d166c772 tempest-VolumesCloneNegativeTest-244418523 None] Lock "cinder-b00e02e5-4f0d-4590-92e2-363df0d4e6bc-delete_volume" released by "delete_volume" :: held 3.497s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:37 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5368eca-4dff-4c6b-b6b9-d2d5b3051714]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a" returned: 0 in 0.592s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 2G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 2G" returned: 0 in 0.330s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.057s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-852a4125-f147-40df-aa00-c6f683e1ebdf tempest-VolumesExtendTest-135405602 None] Extend volume completed successfully.
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-2645d103-932f-4a0a-aa85-3351654f21b2-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Lock "cinder-2645d103-932f-4a0a-aa85-3351654f21b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-quobyte-1da654d9-9bc8-413c-bf35-cae5904f1d1a" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-1da654d9-9bc8-413c-bf35-cae5904f1d1a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-quobyte-2645d103-932f-4a0a-aa85-3351654f21b2" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-2645d103-932f-4a0a-aa85-3351654f21b2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Deleting offline snapshot 2645d103-932f-4a0a-aa85-3351654f21b2 of volume 1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] snapshot_file for this snap is: volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5f10a-c0b7-4b27-9b0d-5d1a4dbc62f6]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2" returned: 0 in 0.684s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:44:41 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e3659a-9895-4591-9a49-e18f879d1f60]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a" returned: 0 in 0.700s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2" returned: 0 in 0.491s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Flow 'volume_create_manager' (4e84dbe6-48eb-49eb-80a9-f4256f4967d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ec9173-66e9-45b9-96ae-b3cedf7f0a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a.2645d103-932f-4a0a-aa85-3351654f21b2" returned: 0 in 0.467s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ec9173-66e9-45b9-96ae-b3cedf7f0a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-569195526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3455a075-cf2b-419c-b0f4-9632fedb7b79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b297f1179e4a16ade44f0c7d858a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:43Z,use_quota=True,user_id='7fe99a45f0884775aa9f728eb2eecd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6c4275-2c39-431c-8e18-fb6ea9ebacaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6c4275-2c39-431c-8e18-fb6ea9ebacaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b599a5a-bccf-47ad-bac6-8ad87f9a573c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b599a5a-bccf-47ad-bac6-8ad87f9a573c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3455a075-cf2b-419c-b0f4-9632fedb7b79', 'volume_name': 'volume-3455a075-cf2b-419c-b0f4-9632fedb7b79', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1707a159-6d9a-4f72-97a7-2ec39d691ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1707a159-6d9a-4f72-97a7-2ec39d691ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe80903-575d-46d9-bcc7-7c5c7b697cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Volume 3455a075-cf2b-419c-b0f4-9632fedb7b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3455a075-cf2b-419c-b0f4-9632fedb7b79', 'volume_size': 1}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-569195526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3455a075-cf2b-419c-b0f4-9632fedb7b79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b297f1179e4a16ade44f0c7d858a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:43Z,use_quota=True,user_id='7fe99a45f0884775aa9f728eb2eecd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Creating volume 3455a075-cf2b-419c-b0f4-9632fedb7b79 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:43 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:43 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=68, name=volume-3455a075-cf2b-419c-b0f4-9632fedb7b79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-2645d103-932f-4a0a-aa85-3351654f21b2" released by "_delete_snapshot" :: held 2.950s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-1da654d9-9bc8-413c-bf35-cae5904f1d1a" released by "delete_snapshot" :: held 3.027s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79 1073741824" returned: 0 in 0.593s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:44 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Created reservations ['6ff219e5-0229-40a6-9868-1e01840effc2', '1ab49943-aa8f-46c3-9c99-c5ed4cb9d19e', '65512318-ec0c-44e5-9db5-89d3b5c3903b', '2de673ed-df24-4aa6-beb0-88ecdcc793a6'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:44:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79" returned: 0 in 0.295s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] <== create_volume: return (919ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe80903-575d-46d9-bcc7-7c5c7b697cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3455a075-cf2b-419c-b0f4-9632fedb7b79', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffaf58e9-5cb8-42c4-96c1-f655bd87fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-1da654d9-9bc8-413c-bf35-cae5904f1d1a-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:45 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Volume volume-3455a075-cf2b-419c-b0f4-9632fedb7b79 (3455a075-cf2b-419c-b0f4-9632fedb7b79): created successfully
Sep 17 07:44:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffaf58e9-5cb8-42c4-96c1-f655bd87fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Flow 'volume_create_manager' (4e84dbe6-48eb-49eb-80a9-f4256f4967d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:46 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-18a79a45-e32e-447c-b1d8-467bc658830a tempest-VolumesListTestJSON-1966814178 None] Created volume successfully.
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Lock "cinder-1da654d9-9bc8-413c-bf35-cae5904f1d1a-delete_volume" acquired by "delete_volume" :: waited 0.177s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:46 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Delete snapshot completed successfully.
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5bde8504-be5f-4c80-96de-430eca86d654 tempest-VolumesExtendTest-135405602 None] Lock "cinder-2645d103-932f-4a0a-aa85-3351654f21b2-delete_snapshot" released by "delete_snapshot" :: held 5.405s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:46 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Acquiring lock "cinder-quobyte-1da654d9-9bc8-413c-bf35-cae5904f1d1a" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.260s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-1da654d9-9bc8-413c-bf35-cae5904f1d1a" acquired by "delete_volume" :: waited 0.363s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[74422173-3127-495c-a10c-c7998af8a39a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a" returned: 0 in 0.805s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1da654d9-9bc8-413c-bf35-cae5904f1d1a" returned: 0 in 0.190s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Lock "cinder-quobyte-1da654d9-9bc8-413c-bf35-cae5904f1d1a" released by "delete_volume" :: held 1.195s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:47 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Flow 'volume_create_manager' (d7dcc9f5-f765-49f4-8b27-d8708a1c397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd937c0d-d87d-4dc8-8fe3-a1b91e79f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd937c0d-d87d-4dc8-8fe3-a1b91e79f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-895946987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b297f1179e4a16ade44f0c7d858a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:47Z,use_quota=True,user_id='7fe99a45f0884775aa9f728eb2eecd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5382db17-7e65-4af7-95ac-bfbd268f3136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5382db17-7e65-4af7-95ac-bfbd268f3136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5464aa-2df7-4b10-be2d-737d329c3c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5464aa-2df7-4b10-be2d-737d329c3c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb', 'volume_name': 'volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfcedf2-001e-478a-872a-8a9f69d92494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfcedf2-001e-478a-872a-8a9f69d92494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519234c4-a506-4e19-a1ba-ede0849547fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:48 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Volume d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb', 'volume_size': 1}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-895946987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b297f1179e4a16ade44f0c7d858a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:47Z,use_quota=True,user_id='7fe99a45f0884775aa9f728eb2eecd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Creating volume d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:48 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:48 devstack quobyte-client[83654]: System call of process 92591 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:48 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=69, name=volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb 1073741824" returned: 0 in 0.702s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb" returned: 0 in 0.270s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] <== create_volume: return (1073ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Created reservations ['df3b03b3-3a50-4822-bfbe-b3cb2deb48d0', '1cd0eef6-517e-4e61-b25c-094eb8dc4f4f', '065b5406-b0a7-420b-aff8-be9c03c58bd8', 'bb4e045e-a1c4-412a-be14-2e1ce1b4c2dd'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519234c4-a506-4e19-a1ba-ede0849547fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408df0e1-20fe-439c-933c-4db8e008bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:49 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Volume volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb (d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb): created successfully
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408df0e1-20fe-439c-933c-4db8e008bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Flow 'volume_create_manager' (d7dcc9f5-f765-49f4-8b27-d8708a1c397a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3a451b56-6de1-456b-89fb-2a68b2a6247d tempest-VolumesListTestJSON-1966814178 None] Created volume successfully.
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.290s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:50 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:44:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Deleted volume successfully.
Sep 17 07:44:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a400535a-872b-49dd-9d17-5e353c698656 tempest-VolumesExtendTest-135405602 None] Lock "cinder-1da654d9-9bc8-413c-bf35-cae5904f1d1a-delete_volume" released by "delete_volume" :: held 4.647s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:44:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:51 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Flow 'volume_create_manager' (a2288eb5-8a71-435a-b4cf-5162e6140da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52834a59-db87-4b4f-bfdc-696ccf7879a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52834a59-db87-4b4f-bfdc-696ccf7879a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-270347043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b297f1179e4a16ade44f0c7d858a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:52Z,use_quota=True,user_id='7fe99a45f0884775aa9f728eb2eecd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e09e9f-d9c3-45f4-a112-f873c10f1335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e09e9f-d9c3-45f4-a112-f873c10f1335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7328389-b53f-4def-a5a9-82034c8d24cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7328389-b53f-4def-a5a9-82034c8d24cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba', 'volume_name': 'volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b6162f-2501-4cdf-970d-1730a0bff5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b6162f-2501-4cdf-970d-1730a0bff5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bcbe6f-4c5b-4dc8-aefd-78026dcab3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Volume b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba', 'volume_size': 1}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-270347043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8b297f1179e4a16ade44f0c7d858a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:52Z,use_quota=True,user_id='7fe99a45f0884775aa9f728eb2eecd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Creating volume b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:52 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:52 devstack quobyte-client[83654]: System call of process 92629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:44:52 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=70, name=volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba 1073741824" returned: 0 in 0.408s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba" returned: 0 in 0.165s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] <== create_volume: return (666ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bcbe6f-4c5b-4dc8-aefd-78026dcab3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1f6f9c-9c21-487d-9798-8b47ad5da302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:53 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Volume volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba (b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba): created successfully
Sep 17 07:44:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1f6f9c-9c21-487d-9798-8b47ad5da302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Flow 'volume_create_manager' (a2288eb5-8a71-435a-b4cf-5162e6140da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4c25633f-496f-40f6-821c-6c2489a93281 tempest-VolumesListTestJSON-1966814178 None] Created volume successfully.
Sep 17 07:44:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Flow 'volume_create_manager' (997a5ce9-55b2-4791-a959-2a9055f50fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590fde07-4615-4821-9a0d-7b158d725701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590fde07-4615-4821-9a0d-7b158d725701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-434384335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1986210a-019a-48f6-8d0d-d39ea5a3d05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb25d3918b9488aab74a0e68111e0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:57Z,use_quota=True,user_id='3dc863c31556447bb3dd030202074352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79feb9e-f1ab-4c93-ba1a-8846eaf82488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79feb9e-f1ab-4c93-ba1a-8846eaf82488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f5578a-b878-4208-9a44-b88a3a072524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f5578a-b878-4208-9a44-b88a3a072524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1986210a-019a-48f6-8d0d-d39ea5a3d05a', 'volume_name': 'volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2939bfd-73eb-49a9-aca1-84e8aa0e60da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2939bfd-73eb-49a9-aca1-84e8aa0e60da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8582082-7f1e-45ff-8804-37bd03fa2daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:57 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Volume 1986210a-019a-48f6-8d0d-d39ea5a3d05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a', 'volume_size': 1}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-434384335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1986210a-019a-48f6-8d0d-d39ea5a3d05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbb25d3918b9488aab74a0e68111e0ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:57Z,use_quota=True,user_id='3dc863c31556447bb3dd030202074352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Creating volume 1986210a-019a-48f6-8d0d-d39ea5a3d05a {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:44:57 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:44:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:57 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=71, name=volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:44:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "cinder-ccfa5b36-b524-4870-a770-4063c4576e5f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-ccfa5b36-b524-4870-a770-4063c4576e5f-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a 1073741824" returned: 0 in 0.751s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a" returned: 0 in 0.550s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] <== create_volume: return (1382ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:44:59 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "cinder-quobyte-ccfa5b36-b524-4870-a770-4063c4576e5f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8582082-7f1e-45ff-8804-37bd03fa2daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10bbaa6-8586-4b3c-a1b3-a2302b9569f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-quobyte-ccfa5b36-b524-4870-a770-4063c4576e5f" acquired by "delete_volume" :: waited 0.138s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "cinder-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce9953-c72e-4aff-8fe2-5ade75dd02cb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:44:59 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Volume volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a (1986210a-019a-48f6-8d0d-d39ea5a3d05a): created successfully
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10bbaa6-8586-4b3c-a1b3-a2302b9569f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Flow 'volume_create_manager' (997a5ce9-55b2-4791-a959-2a9055f50fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba-delete_volume" acquired by "delete_volume" :: waited 0.437s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:44:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-241d3c77-3583-402a-875d-c5e8908f576f tempest-VolumesNegativeTest-1201987002 None] Created volume successfully.
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f" returned: 0 in 0.587s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:44:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "cinder-quobyte-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ccfa5b36-b524-4870-a770-4063c4576e5f" returned: 0 in 0.289s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-quobyte-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba" acquired by "delete_volume" :: waited 0.132s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-quobyte-ccfa5b36-b524-4870-a770-4063c4576e5f" released by "delete_volume" :: held 1.007s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15e480-00bf-4e44-8d0e-b86bc3b9ae2a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:00 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Created reservations ['4605807c-120e-425d-a691-dc0a67371075', '8255c380-56c5-4d85-b4e2-60c2681bd3e9', 'edafd73d-77db-4e4d-a4e1-799f47b16fc0', '27fff727-b89c-454c-b1f8-623da08f9b0d'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba" returned: 0 in 0.703s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.040s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba" returned: 0 in 0.341s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-quobyte-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba" released by "delete_volume" :: held 1.393s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "cinder-54db526e-ba0c-4fb2-9917-9fed54c25bbe-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.505s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:01 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Deleted volume successfully.
Sep 17 07:45:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-54db526e-ba0c-4fb2-9917-9fed54c25bbe-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9b8e0f79-0f42-4dd0-a55b-d3caa66f4ede tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-ccfa5b36-b524-4870-a770-4063c4576e5f-delete_volume" released by "delete_volume" :: held 3.815s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:02 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "cinder-quobyte-54db526e-ba0c-4fb2-9917-9fed54c25bbe" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Created reservations ['835208a5-867f-405c-91de-0602fa85d993', '3f4b8841-7428-40a2-b4b5-61be7b364355', '6b76b396-65c8-4cac-b7cb-82cb775960e2', '8f592743-6c6b-4ebb-8995-f5dcb50211e3'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-quobyte-54db526e-ba0c-4fb2-9917-9fed54c25bbe" acquired by "delete_volume" :: waited 0.043s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfd9ea-416a-4303-b366-a22875594b50]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.129s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:02 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:02 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Deleted volume successfully.
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "cinder-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe" returned: 0 in 1.136s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3e89df2a-00d7-4111-ab62-fb1a292405d6 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-b29cc04c-4ba1-40ef-a598-db5d9dfbd7ba-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-54db526e-ba0c-4fb2-9917-9fed54c25bbe" returned: 0 in 0.234s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb-delete_volume" acquired by "delete_volume" :: waited 0.326s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-quobyte-54db526e-ba0c-4fb2-9917-9fed54c25bbe" released by "delete_volume" :: held 1.562s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "cinder-quobyte-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-quobyte-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb" acquired by "delete_volume" :: waited 0.020s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:03 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Created reservations ['9ce90850-c5f9-4236-befa-2a1918580c34', 'd6a0aa52-59fe-4372-8dce-2161956d9673', '9af7780b-e58c-4d91-ae25-34e176452e32', '3bf1fd51-92b5-4edb-b21c-132693ec6239'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab97201-6171-47b4-89c6-8864c4994660]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.119s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:04 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Deleted volume successfully.
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb" returned: 0 in 0.874s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5469691d-eaa2-49a4-b1d0-827c0ebf5fb5 tempest-AttachVolumeShelveTestJSON-134626373 None] Lock "cinder-54db526e-ba0c-4fb2-9917-9fed54c25bbe-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb" returned: 0 in 0.296s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-quobyte-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb" released by "delete_volume" :: held 1.270s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Created reservations ['840247f0-bbd2-4d9e-9c5d-2638f8a5ddd8', 'd0ff6320-8995-44ef-afe9-e05b48cae100', '5028e462-82c7-48b2-81dd-fdee5184d28f', '563193d1-3c6c-4f21-bee4-02a242aa3b3e'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:05 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Deleted volume successfully.
Sep 17 07:45:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e255d896-dd13-4499-8d4e-763acf6fd994 tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-d4e1bef2-9bc4-4fc7-adcb-ca54b6ff31fb-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "cinder-3455a075-cf2b-419c-b0f4-9632fedb7b79-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-3455a075-cf2b-419c-b0f4-9632fedb7b79-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:07 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "cinder-quobyte-3455a075-cf2b-419c-b0f4-9632fedb7b79" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-quobyte-3455a075-cf2b-419c-b0f4-9632fedb7b79" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:07 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69863b3-c55d-43c9-93a4-40799db35796]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79" returned: 0 in 0.680s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3455a075-cf2b-419c-b0f4-9632fedb7b79" returned: 0 in 0.202s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-quobyte-3455a075-cf2b-419c-b0f4-9632fedb7b79" released by "delete_volume" :: held 1.200s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:08 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Created reservations ['b93452e6-bc7a-4fc4-9d0b-90e104b07b20', '7b166fdb-883f-47cd-a858-4a8cb2a34ea9', 'ce0b3eae-21e9-4c10-819f-86a4aac03139', '67fe08a9-6ace-4595-a054-b41628e1f194'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.331s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:09 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Deleted volume successfully.
Sep 17 07:45:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5746c295-55ad-46fd-a902-77ec95d5529d tempest-VolumesListTestJSON-1966814178 None] Lock "cinder-3455a075-cf2b-419c-b0f4-9632fedb7b79-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:17 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Flow 'volume_create_manager' (bd31d588-3c7d-467f-9f04-bcb1cd5f8644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a0ad9e-75f3-4038-8c2b-23339a163ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a0ad9e-75f3-4038-8c2b-23339a163ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1750503939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0413a2-15db-404f-940f-3241759dd476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322687344ae54a18a08757b5ca1ce614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:45:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:45:18Z,use_quota=True,user_id='bcbd6e0e04214784be0fc4413edaf176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1149a4-e774-460f-bfd2-4731eb6158c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1149a4-e774-460f-bfd2-4731eb6158c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fe3e54-f20d-4498-a090-20873f93f567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fe3e54-f20d-4498-a090-20873f93f567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0413a2-15db-404f-940f-3241759dd476', 'volume_name': 'volume-6b0413a2-15db-404f-940f-3241759dd476', 'volume_size': 2}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cae5ac-5b80-4089-aabf-9390191c4a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cae5ac-5b80-4089-aabf-9390191c4a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38076248-2981-4a71-8a6b-2717232b9dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:45:18 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume 6b0413a2-15db-404f-940f-3241759dd476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0413a2-15db-404f-940f-3241759dd476', 'volume_size': 2}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1750503939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0413a2-15db-404f-940f-3241759dd476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322687344ae54a18a08757b5ca1ce614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:45:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:45:18Z,use_quota=True,user_id='bcbd6e0e04214784be0fc4413edaf176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Creating volume 6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:45:18 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 2147483648 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:18 devstack quobyte-client[83654]: System call of process 92689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:45:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=72, name=volume-6b0413a2-15db-404f-940f-3241759dd476, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 2147483648" returned: 0 in 0.535s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] <== create_volume: return (754ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:45:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38076248-2981-4a71-8a6b-2717232b9dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0413a2-15db-404f-940f-3241759dd476', 'volume_size': 2}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:45:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea4d90e-e273-411f-a12b-812ce2866e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:45:19 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume volume-6b0413a2-15db-404f-940f-3241759dd476 (6b0413a2-15db-404f-940f-3241759dd476): created successfully
Sep 17 07:45:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea4d90e-e273-411f-a12b-812ce2866e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:45:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Flow 'volume_create_manager' (bd31d588-3c7d-467f-9f04-bcb1cd5f8644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:45:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-36e5d5b7-5a44-4e18-9e71-199893824c0f tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Created volume successfully.
Sep 17 07:45:20 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Creating offline snapshot 19dd2308-9384-4793-89ea-d2f4354d1930 of volume 6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:45:20 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef0c806-2a0e-47b5-9a35-b15e2c3665f5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:21 devstack quobyte-client[83654]: System call of process 92699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476" returned: 0 in 0.612s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 2G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:21 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=73, name=volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 2G" returned: 0 in 0.321s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6b0413a2-15db-404f-940f-3241759dd476 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:21 devstack quobyte-client[83654]: System call of process 92711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "qemu-img rebase -u -b volume-6b0413a2-15db-404f-940f-3241759dd476 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930" returned: 0 in 0.285s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:45:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930" returned: 0 in 0.189s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930" returned: 0 in 0.147s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.info" returned: 0 in 0.138s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.info" returned: 0 in 0.149s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:23 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fb438052-274e-4317-8c8a-573a02ffa8cd tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Create snapshot completed successfully
Sep 17 07:45:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "cinder-19dd2308-9384-4793-89ea-d2f4354d1930-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-19dd2308-9384-4793-89ea-d2f4354d1930-delete_snapshot" acquired by "delete_snapshot" :: waited 0.244s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:23 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "cinder-quobyte-6b0413a2-15db-404f-940f-3241759dd476" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-quobyte-6b0413a2-15db-404f-940f-3241759dd476" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "cinder-quobyte-19dd2308-9384-4793-89ea-d2f4354d1930" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-quobyte-19dd2308-9384-4793-89ea-d2f4354d1930" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Deleting offline snapshot 19dd2308-9384-4793-89ea-d2f4354d1930 of volume 6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] snapshot_file for this snap is: volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadffe8e-f9eb-4ab0-9c36-cf0053dca354]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:25 devstack quobyte-client[83654]: System call of process 92746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:45:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930" returned: 0 in 1.437s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b0413a2-15db-404f-940f-3241759dd476(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:45:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ace9dd-43f5-498f-9481-e4b751994dc1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476" returned: 0 in 0.974s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:27 devstack quobyte-client[83654]: System call of process 92785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:45:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930" returned: 0 in 0.685s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476.19dd2308-9384-4793-89ea-d2f4354d1930" returned: 0 in 0.208s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-quobyte-19dd2308-9384-4793-89ea-d2f4354d1930" released by "_delete_snapshot" :: held 4.349s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-quobyte-6b0413a2-15db-404f-940f-3241759dd476" released by "delete_snapshot" :: held 4.448s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:28 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Created reservations ['8d0ab6a5-c30b-41cb-8824-da4832f5669a', '17752b85-661c-4701-a2d2-630bc518f7ed', '113ee618-339d-44cb-b93e-27c5f32090f9', '02ef922b-f422-431c-a8d3-2cfc225efc32'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Delete snapshot completed successfully.
Sep 17 07:45:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f6ecfe1a-a58e-4785-b9e0-e202bba31674 tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-19dd2308-9384-4793-89ea-d2f4354d1930-delete_snapshot" released by "delete_snapshot" :: held 5.257s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "cinder-6b0413a2-15db-404f-940f-3241759dd476-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-6b0413a2-15db-404f-940f-3241759dd476-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "cinder-quobyte-6b0413a2-15db-404f-940f-3241759dd476" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-quobyte-6b0413a2-15db-404f-940f-3241759dd476" acquired by "delete_volume" :: waited 0.027s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e987d542-37a3-4f10-85e1-62b967b52103]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476" returned: 0 in 1.157s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6b0413a2-15db-404f-940f-3241759dd476" returned: 0 in 0.294s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-quobyte-6b0413a2-15db-404f-940f-3241759dd476" released by "delete_volume" :: held 1.911s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:32 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=59,cinder:UPDATE=100,cinder:DELETE=8,cinder:INSERT=23 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:45:32 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=55,cinder:UPDATE=71,cinder:DELETE=8,cinder:INSERT=13 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:45:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Created reservations ['2a9e94e0-c479-40e2-924f-8e15da17d452', 'dc35c725-1e5d-4e12-ae9f-2fc0cc0ff915', '871f3b22-4a68-473c-ab38-59fd5cd7b9e2', '8d196dc5-ae90-4769-96c0-009fd0181d1e'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.316s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:33 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:33 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Deleted volume successfully.
Sep 17 07:45:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3247eaf-ebf9-49f2-a6ae-6a7cf83c71cc tempest-VolumesSnapshotNegativeTestJSON-764929601 None] Lock "cinder-6b0413a2-15db-404f-940f-3241759dd476-delete_volume" released by "delete_volume" :: held 5.306s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:42 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:45:44 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.193s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Acquiring lock "cinder-1986210a-019a-48f6-8d0d-d39ea5a3d05a-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Lock "cinder-1986210a-019a-48f6-8d0d-d39ea5a3d05a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Acquiring lock "cinder-quobyte-1986210a-019a-48f6-8d0d-d39ea5a3d05a" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Lock "cinder-quobyte-1986210a-019a-48f6-8d0d-d39ea5a3d05a" acquired by "delete_volume" :: waited 0.018s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7f784-fbbb-4722-b5db-4fe924c778a6]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:45:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:56 devstack quobyte-client[83654]: System call of process 92891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:45:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a" returned: 0 in 0.899s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1986210a-019a-48f6-8d0d-d39ea5a3d05a" returned: 0 in 0.256s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Lock "cinder-quobyte-1986210a-019a-48f6-8d0d-d39ea5a3d05a" released by "delete_volume" :: held 1.745s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:45:58 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Created reservations ['dd3f3d39-6450-4ef7-b001-04bdf5cbf8a5', '0bee2012-9756-47dd-a1df-4d0792d9aea6', '04e5705d-035b-41c3-8743-95d059c40731', '0b3a9b5e-9b7c-4143-b009-f855b232d825'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.290s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:45:59 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:45:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Deleted volume successfully.
Sep 17 07:46:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26186237-93ca-431b-97dc-1264d32175c9 tempest-VolumesNegativeTest-1201987002 None] Lock "cinder-1986210a-019a-48f6-8d0d-d39ea5a3d05a-delete_volume" released by "delete_volume" :: held 4.924s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Flow 'volume_create_manager' (7bf0987b-65cc-4674-9438-da73e3fd2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69674a1-e5bc-4ab8-b0e6-71bdc48df1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69674a1-e5bc-4ab8-b0e6-71bdc48df1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2058971963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba005f40-dcad-47a2-9398-e8d0dcb5bf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c2c9479fb14d1f816b7a7ad6d72577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:03Z,use_quota=True,user_id='d607fb72fb604e9b8d87c87ea7727c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a29c3e-02a5-4381-9577-1a2fa2382301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a29c3e-02a5-4381-9577-1a2fa2382301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432f0317-89e7-4f76-893b-603ed8ca5236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432f0317-89e7-4f76-893b-603ed8ca5236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba005f40-dcad-47a2-9398-e8d0dcb5bf0c', 'volume_name': 'volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3150decc-5c56-4247-ad15-d220a94e911e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3150decc-5c56-4247-ad15-d220a94e911e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47851c8e-fc7e-48da-81d8-9df6bd16f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:03 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c', 'volume_size': 1}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2058971963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba005f40-dcad-47a2-9398-e8d0dcb5bf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c2c9479fb14d1f816b7a7ad6d72577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:03Z,use_quota=True,user_id='d607fb72fb604e9b8d87c87ea7727c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Creating volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:46:03 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:46:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:04 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=75, name=volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c 1073741824" returned: 0 in 0.540s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" returned: 0 in 0.115s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] <== create_volume: return (807ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47851c8e-fc7e-48da-81d8-9df6bd16f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495b57a8-2c9b-4f10-9347-5294b8cddf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:05 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c (ba005f40-dcad-47a2-9398-e8d0dcb5bf0c): created successfully
Sep 17 07:46:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (495b57a8-2c9b-4f10-9347-5294b8cddf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Flow 'volume_create_manager' (7bf0987b-65cc-4674-9438-da73e3fd2132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:46:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7f56933e-2b4b-4870-9063-89c029882636 tempest-VolumesSnapshotListTestJSON-543377942 None] Created volume successfully.
Sep 17 07:46:06 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:06 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Creating offline snapshot 7d5eea7c-99b2-407d-beb7-66ce692acc62 of volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:46:06 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f63ae6-bf61-44e5-a9f9-9f2bc7860c48]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:06 devstack quobyte-client[83654]: System call of process 92922 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" returned: 0 in 0.719s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:07 devstack quobyte-client[83654]: System call of process 92928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:07 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=76, name=volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:46:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 1G" returned: 0 in 0.581s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img rebase -u -b volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.227s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:46:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.202s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.151s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.info" returned: 0 in 0.239s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.info" returned: 0 in 0.154s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.777s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ae5b2395-053d-4ef1-9666-cc756a332bbb tempest-VolumesSnapshotListTestJSON-543377942 None] Create snapshot completed successfully
Sep 17 07:46:11 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Creating offline snapshot 26cf9075-a89f-4ab8-8d06-d47a753034e8 of volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:46:11 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fc4580-f0b6-4116-8cea-d52ba1da9b5a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 1.479s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:13 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=78, name=volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:46:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 1G" returned: 0 in 0.666s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:14 devstack quobyte-client[83654]: System call of process 93007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img rebase -u -b volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.345s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:46:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.395s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:46:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.294s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.861s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:16 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9c547cc5-0872-49e8-9b6b-d9617ff07130 tempest-VolumesSnapshotListTestJSON-543377942 None] Create snapshot completed successfully
Sep 17 07:46:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Creating offline snapshot 26f702a7-2196-435f-a248-515a198774c0 of volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:46:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf978414-5ba7-449f-9913-7ffa4a534312]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.978s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:19 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=79, name=volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:46:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 1G" returned: 0 in 0.608s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img rebase -u -b volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0" returned: 0 in 0.349s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:46:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0" returned: 0 in 0.286s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:46:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0" returned: 0 in 0.433s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.457s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-062257a1-73cb-4fe3-8780-4f7f5021999f tempest-VolumesSnapshotListTestJSON-543377942 None] Create snapshot completed successfully
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-26f702a7-2196-435f-a248-515a198774c0-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-26f702a7-2196-435f-a248-515a198774c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-26f702a7-2196-435f-a248-515a198774c0" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-26f702a7-2196-435f-a248-515a198774c0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Deleting offline snapshot 26f702a7-2196-435f-a248-515a198774c0 of volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] snapshot_file for this snap is: volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[708674c5-5429-4660-a412-eceed2c2d94a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:25 devstack quobyte-client[83654]: System call of process 93042 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0" returned: 0 in 0.590s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6de26d2-65a6-4104-b293-346f8769767e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.526s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0" returned: 0 in 0.418s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26f702a7-2196-435f-a248-515a198774c0" returned: 0 in 0.127s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-26f702a7-2196-435f-a248-515a198774c0" released by "_delete_snapshot" :: held 2.179s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" released by "delete_snapshot" :: held 2.213s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Created reservations ['c3d4faf7-507f-4751-b9ea-2ba0d01b0c7c', '4b450f7e-0eb7-444b-8958-f69680c0ca62', 'af21f988-43a6-4db3-9658-d9527e89ac54', 'd394b288-cf43-4a93-9382-f7d91237bc85'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:46:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Delete snapshot completed successfully.
Sep 17 07:46:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9fb875fd-9e3a-4477-be85-c00c66442469 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-26f702a7-2196-435f-a248-515a198774c0-delete_snapshot" released by "delete_snapshot" :: held 2.765s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-26cf9075-a89f-4ab8-8d06-d47a753034e8-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-26cf9075-a89f-4ab8-8d06-d47a753034e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.157s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-26cf9075-a89f-4ab8-8d06-d47a753034e8" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-26cf9075-a89f-4ab8-8d06-d47a753034e8" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Deleting offline snapshot 26cf9075-a89f-4ab8-8d06-d47a753034e8 of volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] snapshot_file for this snap is: volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb09fda-bf45-440e-9439-b12c57a97f9b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:29 devstack quobyte-client[83654]: System call of process 93055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 1.449s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf65205-196b-4849-9bb3-af59991d351b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:30 devstack quobyte-client[83654]: System call of process 93058 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.773s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.320s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.26cf9075-a89f-4ab8-8d06-d47a753034e8" returned: 0 in 0.148s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-26cf9075-a89f-4ab8-8d06-d47a753034e8" released by "_delete_snapshot" :: held 3.207s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" released by "delete_snapshot" :: held 3.280s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Created reservations ['f8323d6a-d592-4d37-b68e-996ca6ffd49c', 'e204cde0-b7cc-47d2-b48f-7bde0da8a0e5', 'c41a4527-b6c5-4434-8daf-d498faaa422f', '34d54ae9-5c66-4ef0-bc11-d8587a0c2457'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:46:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Flow 'volume_create_manager' (e9b3aecb-c93e-4515-98e4-3c5259f8d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9fadcf-b18b-4005-a263-d550d929c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9fadcf-b18b-4005-a263-d550d929c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-90551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa428f5-2d6b-48c2-be96-349ee6c39c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2971a1ddd7f44febb0380e17242d64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:32Z,use_quota=True,user_id='03fa3dbcd1ad455b9abab75972ceb729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5604176-b7a7-41e8-9c79-44f72aefcf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5604176-b7a7-41e8-9c79-44f72aefcf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a224e0-2ea4-4bec-aa8d-eb741165fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Delete snapshot completed successfully.
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fb99d72e-6abf-421a-b196-0b99d1ad0fe5 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-26cf9075-a89f-4ab8-8d06-d47a753034e8-delete_snapshot" released by "delete_snapshot" :: held 4.479s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a224e0-2ea4-4bec-aa8d-eb741165fbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5fa428f5-2d6b-48c2-be96-349ee6c39c1d', 'volume_name': 'volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c863a1060>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b05072-28f8-40aa-b9b6-515ef0c7ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b05072-28f8-40aa-b9b6-515ef0c7ae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7537cb85-48bf-4423-90df-30e0914131b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:32 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Volume 5fa428f5-2d6b-48c2-be96-349ee6c39c1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c863a1060>}
Sep 17 07:46:32 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Cloning 5fa428f5-2d6b-48c2-be96-349ee6c39c1d from image f78f338c-82d6-4001-a9f8-06473b1187dc  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 07:46:33 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 07:46:33 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 07:46:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[856988dc-fa56-4e75-ad00-cc69c0f57f71]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-7d5eea7c-99b2-407d-beb7-66ce692acc62-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:34 devstack sudo[93065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD
Sep 17 07:46:34 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-7d5eea7c-99b2-407d-beb7-66ce692acc62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.146s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:34 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-7d5eea7c-99b2-407d-beb7-66ce692acc62" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-7d5eea7c-99b2-407d-beb7-66ce692acc62" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Deleting offline snapshot 7d5eea7c-99b2-407d-beb7-66ce692acc62 of volume ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] snapshot_file for this snap is: volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[812bb7d5-1a6e-41ba-a4b4-bb1a618550a1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:35 devstack quobyte-client[83654]: System call of process 93067 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.789s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:46:35 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8904763c-a2ad-4754-848e-36c5f21638bf]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" returned: 0 in 0.993s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:36 devstack quobyte-client[83654]: System call of process 93077 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.526s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:36 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD" returned: 0 in 3.516s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc is fetched for user 03fa3dbcd1ad455b9abab75972ceb729. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c.7d5eea7c-99b2-407d-beb7-66ce692acc62" returned: 0 in 0.313s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-7d5eea7c-99b2-407d-beb7-66ce692acc62" released by "_delete_snapshot" :: held 2.996s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" released by "delete_snapshot" :: held 3.038s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1415ee-a876-4fc6-8992-685690043efc]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:38 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Created reservations ['f572ce89-0944-4c11-89d8-26706d7e4a3a', '215b3e03-b193-4224-80e9-cbbe29c13d8a', 'f8aab27b-ce13-4e2a-a20a-27f5ac0031af', '9cc4e25e-1f33-47eb-acab-1b53d222c586'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:46:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Delete snapshot completed successfully.
Sep 17 07:46:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e5a93507-abe9-402f-b6ab-c7d7389fd897 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-7d5eea7c-99b2-407d-beb7-66ce692acc62-delete_snapshot" released by "delete_snapshot" :: held 4.161s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:38 devstack sudo[93081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD
Sep 17 07:46:38 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:46:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:46:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:46:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" acquired by "delete_volume" :: waited 0.034s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:46:39 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ab8751-182d-4c8e-a62d-e593089398b5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:40 devstack quobyte-client[83654]: System call of process 93086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" returned: 0 in 0.865s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:40 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root
Sep 17 07:46:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD" returned: 0 in 3.339s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-90551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa428f5-2d6b-48c2-be96-349ee6c39c1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2971a1ddd7f44febb0380e17242d64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:32Z,use_quota=True,user_id='03fa3dbcd1ad455b9abab75972ceb729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Creating volume 5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:46:41 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" returned: 0 in 0.310s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-quobyte-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c" released by "delete_volume" :: held 1.495s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:41 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=80, name=volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d 1073741824" returned: 0 in 0.621s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 0.212s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Created reservations ['423e52ae-db08-42b8-bf44-a8441673a5af', '13f4807f-2033-4391-a974-cb42e804fc75', '964abfcd-af0d-42fc-af68-8be588f8a841', '6540cd6b-1932-4d0d-84b7-b3303cc141b3'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Attempting download of f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 5fa428f5-2d6b-48c2-be96-349ee6c39c1d. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a3bdd-daaa-41af-814f-d3c5f793bffc]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_vc53imha {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.239s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:42 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:46:42 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Deleted volume successfully.
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9fa331b-9504-49f8-b0f7-bbe38ee2e342 tempest-VolumesSnapshotListTestJSON-543377942 None] Lock "cinder-ba005f40-dcad-47a2-9398-e8d0dcb5bf0c-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_vc53imha" returned: 0 in 0.615s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_vc53imha {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_vc53imha" returned: 1 in 0.508s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_vc53imha' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066e6e3-dbbc-47bd-beb6-e67dfba71f09]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD" returned: 0 in 0.625s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:44 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] f78f338c-82d6-4001-a9f8-06473b1187dc was qcow2, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 07:46:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:44 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=80, name=volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 2.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_d_smve05devstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:46:46 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Converted 112.00 MB image at 52.40 MB/s
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.330s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:46:46 devstack quobyte-client[83654]: System call of process 93112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d 1G" returned: 0 in 0.288s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:47 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf122379-8c00-4ba1-9e47-1630d66efdc0]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:46:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 0.565s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:46:48 devstack quobyte-client[83654]: System call of process 93117 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 1 in 0.574s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Downloaded image f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 5fa428f5-2d6b-48c2-be96-349ee6c39c1d successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc for user 03fa3dbcd1ad455b9abab75972ceb729 is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Marking volume 5fa428f5-2d6b-48c2-be96-349ee6c39c1d as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Copying metadata from image f78f338c-82d6-4001-a9f8-06473b1187dc to 5fa428f5-2d6b-48c2-be96-349ee6c39c1d. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Creating volume glance metadata for volume 5fa428f5-2d6b-48c2-be96-349ee6c39c1d backed by image f78f338c-82d6-4001-a9f8-06473b1187dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7537cb85-48bf-4423-90df-30e0914131b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c863a1060>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea436320-7a46-442f-8910-77f7cf99cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:46:48 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Volume volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d (5fa428f5-2d6b-48c2-be96-349ee6c39c1d): created successfully
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea436320-7a46-442f-8910-77f7cf99cf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:46:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Flow 'volume_create_manager' (e9b3aecb-c93e-4515-98e4-3c5259f8d500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:46:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2c10c6fe-fed5-4395-8172-f60d1d653227 tempest-TestShelveInstance-1175764700 None] Created volume successfully.
Sep 17 07:46:59 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=49,cinder:SELECT=42,cinder:INSERT=21,cinder:DELETE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:46:59 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=33,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:47:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:47:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:47:02 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfb5f11-fd53-4dbf-a351-86414ca9e8fb]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:47:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:47:03 devstack quobyte-client[83654]: System call of process 93219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:47:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 1.000s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:47:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:47:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 1 in 0.849s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:47:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:47:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.088s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:47:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c1f1dae-9a82-4c85-8b15-b4950c3b11aa', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:47:05 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:47:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-bcfba55a-a169-4ebe-ba70-59cf4c62bc71 req-51b8f38c-3bf6-44bc-bb9a-ce512fd19c38 tempest-TestShelveInstance-1175764700 None] attachment_update completed successfully.
Sep 17 07:47:15 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:47:15 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:47:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Flow 'volume_create_manager' (fb135805-3eda-4203-9513-df2c5cd27068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6eb54f-f2fb-4105-8722-2cf45052ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6eb54f-f2fb-4105-8722-2cf45052ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-55688800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d80e0b-2d6c-46bd-8370-81e8dc13a0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8151b17e0a8d49e297257de20d9373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:26Z,use_quota=True,user_id='7a9f64fb965b48b3924f6d68e18009ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7488e35d-3760-43d3-a0d8-137680d3a758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7488e35d-3760-43d3-a0d8-137680d3a758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40398d58-8703-46d4-83e6-1e2a8a06e031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40398d58-8703-46d4-83e6-1e2a8a06e031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d80e0b-2d6c-46bd-8370-81e8dc13a0eb', 'volume_name': 'volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2847cc-d4f7-482d-bbe1-fb8db6940831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2847cc-d4f7-482d-bbe1-fb8db6940831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce260d75-451e-4b05-9326-a3358a333fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:47:26 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Volume 80d80e0b-2d6c-46bd-8370-81e8dc13a0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb', 'volume_size': 1}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-55688800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d80e0b-2d6c-46bd-8370-81e8dc13a0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8151b17e0a8d49e297257de20d9373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:26Z,use_quota=True,user_id='7a9f64fb965b48b3924f6d68e18009ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Creating volume 80d80e0b-2d6c-46bd-8370-81e8dc13a0eb {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:47:26 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:47:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:47:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=81, name=volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:47:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb 1073741824" returned: 0 in 1.051s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:47:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:47:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" returned: 0 in 0.291s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:47:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] <== create_volume: return (1708ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:47:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:47:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce260d75-451e-4b05-9326-a3358a333fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:47:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bef170-6332-4b4e-b517-39743913aed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:47:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Volume volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb (80d80e0b-2d6c-46bd-8370-81e8dc13a0eb): created successfully
Sep 17 07:47:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bef170-6332-4b4e-b517-39743913aed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:47:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Flow 'volume_create_manager' (fb135805-3eda-4203-9513-df2c5cd27068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:47:30 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-94c66690-eabc-4804-aace-044976b6292a tempest-AttachVolumeNegativeTest-516126158 None] Created volume successfully.
Sep 17 07:47:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:47:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:47:36 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6046b931-7d9b-4d15-814f-428e07ffc383]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:47:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:47:37 devstack quobyte-client[83654]: System call of process 93751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:47:37 devstack quobyte-client[83654]: System call of process 93751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:47:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" returned: 0 in 0.879s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:47:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.994s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:47:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f39a8ce8-dfaf-43df-bff9-44f9eecc2cce', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:47:37 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:47:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-947b7e51-803f-4b72-9127-fc88e828a21b req-bbdefb04-25c3-429c-b388-55d0453f4b1b tempest-AttachVolumeNegativeTest-516126158 None] attachment_update completed successfully.
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.184s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:47:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:47:48 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:47:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:48:19 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Flow 'volume_create_manager' (7399650f-c179-41a2-9e2f-aff1a633c1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22f3223-f3c6-46c3-b70d-60bf247035ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22f3223-f3c6-46c3-b70d-60bf247035ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-348028917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc299498-5cb8-42f7-8c21-6ca5a9a6574e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab76a36befeb4501bcbe3148f95d72ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:19Z,use_quota=True,user_id='122877c0956e4ea0956b57b5e7301621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d1ad0b-d6af-4610-8336-ea53409513d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d1ad0b-d6af-4610-8336-ea53409513d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d781830e-0e79-4625-b9b9-2b31f9aa9340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d781830e-0e79-4625-b9b9-2b31f9aa9340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc299498-5cb8-42f7-8c21-6ca5a9a6574e', 'volume_name': 'volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d1fa7c-59ea-41bc-b100-e4c11b97a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8d1fa7c-59ea-41bc-b100-e4c11b97a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c24f0f-aba9-45bd-bb65-6bbfd9a77f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:48:19 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Volume dc299498-5cb8-42f7-8c21-6ca5a9a6574e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e', 'volume_size': 1}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-348028917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc299498-5cb8-42f7-8c21-6ca5a9a6574e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab76a36befeb4501bcbe3148f95d72ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:19Z,use_quota=True,user_id='122877c0956e4ea0956b57b5e7301621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Creating volume dc299498-5cb8-42f7-8c21-6ca5a9a6574e {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:48:19 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:48:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:48:19 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=82, name=volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e 1073741824" returned: 0 in 0.821s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" returned: 0 in 0.231s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] <== create_volume: return (1159ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c24f0f-aba9-45bd-bb65-6bbfd9a77f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:48:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224f3f0b-2101-43e9-a07a-86d8284ea45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:48:21 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Volume volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e (dc299498-5cb8-42f7-8c21-6ca5a9a6574e): created successfully
Sep 17 07:48:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224f3f0b-2101-43e9-a07a-86d8284ea45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:48:21 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Flow 'volume_create_manager' (7399650f-c179-41a2-9e2f-aff1a633c1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:48:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8309786d-e28b-4bc5-a4ce-e6ec0f4f1b1f tempest-TestMinimumBasicScenario-1621701283 None] Created volume successfully.
Sep 17 07:48:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:48:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:48:27 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e02594b-4b8b-48ca-b7b8-f0ed1f1b0002]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:48:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:48:28 devstack quobyte-client[83654]: System call of process 94048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:48:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" returned: 0 in 0.871s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:48:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:48:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd28c6d7b-1fe3-46e2-9f54-27d451ecb6fe', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:48:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:48:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-1a7123f7-561b-4f9d-b6a9-e76e1f0bf718 req-40e69215-cef7-45dc-ac4e-a1fc1f887c45 tempest-TestMinimumBasicScenario-1621701283 None] attachment_update completed successfully.
Sep 17 07:48:38 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:48:39 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=5 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.216s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:48:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:49:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-8637de7a-a1b2-4912-bd15-1a8b7af63f10 req-b005adf4-2a40-4b78-8683-f8714a4b4321 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:49:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-8637de7a-a1b2-4912-bd15-1a8b7af63f10 req-b005adf4-2a40-4b78-8683-f8714a4b4321 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:49:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-8637de7a-a1b2-4912-bd15-1a8b7af63f10 req-b005adf4-2a40-4b78-8683-f8714a4b4321 tempest-TestShelveInstance-1175764700 None] Terminate volume connection completed successfully.
Sep 17 07:49:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-8637de7a-a1b2-4912-bd15-1a8b7af63f10 req-b005adf4-2a40-4b78-8683-f8714a4b4321 tempest-TestShelveInstance-1175764700 None] Deleting attachment 1c1f1dae-9a82-4c85-8b15-b4950c3b11aa. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:49:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:49:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:49:18 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[514bfa2c-2837-4f62-a8a3-8f832bdbaf45]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:49:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:49:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 0.453s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:49:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:49:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 1 in 0.505s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:49:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:49:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.152s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:49:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '183201e6-3511-41e2-9cb7-a92a85ca3886', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:49:19 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:49:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-1395a2ff-84eb-4652-9439-c33d6a7c3634 req-1ae64bd7-4557-409d-b919-cea8ddde71cd tempest-TestShelveInstance-1175764700 None] attachment_update completed successfully.
Sep 17 07:49:29 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:49:29 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.107s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:49:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:49:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:50:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-93cb95a1-f6c9-4745-a952-f8ab79c2387a req-1a845b18-1d59-4d89-b5ee-dd09ca0118ef tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:50:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-93cb95a1-f6c9-4745-a952-f8ab79c2387a req-1a845b18-1d59-4d89-b5ee-dd09ca0118ef tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:50:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-93cb95a1-f6c9-4745-a952-f8ab79c2387a req-1a845b18-1d59-4d89-b5ee-dd09ca0118ef tempest-AttachVolumeNegativeTest-516126158 None] Terminate volume connection completed successfully.
Sep 17 07:50:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-93cb95a1-f6c9-4745-a952-f8ab79c2387a req-1a845b18-1d59-4d89-b5ee-dd09ca0118ef tempest-AttachVolumeNegativeTest-516126158 None] Deleting attachment f39a8ce8-dfaf-43df-bff9-44f9eecc2cce. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.395s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:50:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:50:48 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:50:48 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:50:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-4ebac7b5-6e03-487d-8420-bb4ad59c8f12 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:50:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-4ebac7b5-6e03-487d-8420-bb4ad59c8f12 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:50:57 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-4ebac7b5-6e03-487d-8420-bb4ad59c8f12 tempest-TestShelveInstance-1175764700 None] Terminate volume connection completed successfully.
Sep 17 07:50:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-4ebac7b5-6e03-487d-8420-bb4ad59c8f12 tempest-TestShelveInstance-1175764700 None] Deleting attachment 183201e6-3511-41e2-9cb7-a92a85ca3886. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Acquiring lock "cinder-5fa428f5-2d6b-48c2-be96-349ee6c39c1d-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Lock "cinder-5fa428f5-2d6b-48c2-be96-349ee6c39c1d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:50:58 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Acquiring lock "cinder-quobyte-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Lock "cinder-quobyte-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" acquired by "delete_volume" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[24893ea0-1f0a-4e58-80ef-4981add7e463]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 0.483s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:50:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:50:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 1 in 0.456s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:50:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:50:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:50:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:50:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Lock "cinder-quobyte-5fa428f5-2d6b-48c2-be96-349ee6c39c1d" released by "delete_volume" :: held 1.377s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG cinder.quota [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Created reservations ['76bb53ba-d87e-4b74-bf12-8100111fa329', 'ac06cd31-74c0-4737-aba4-93f54c6a294e', 'd81c6b24-c5d8-42b2-af24-a1c17bddecc3', 'ed012a7c-f5ee-4c31-92e0-e74122a1cd80'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.187s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:00 devstack cinder-volume[83645]: DEBUG cinder.manager [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:00 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Deleted volume successfully.
Sep 17 07:51:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-4b61ad93-30b6-4d18-baaa-5e7c1b468dbf req-8c206c7a-eb09-444d-95fe-3de48d1ac1d5 tempest-TestShelveInstance-1175764700 None] Lock "cinder-5fa428f5-2d6b-48c2-be96-349ee6c39c1d-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:10 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:51:10 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:51:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:32 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:51:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (5ea5f7de-90d7-4588-896e-ad5df810db6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878ef411-72c2-4c71-9051-3a266f23827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (878ef411-72c2-4c71-9051-3a266f23827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250689398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae65790-0a19-40ef-8b73-266143c30ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:31Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471236f4-9f0b-4b75-afb9-95155a138574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471236f4-9f0b-4b75-afb9-95155a138574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e692c2-87c3-4b3d-994c-df8f2f1c19d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e692c2-87c3-4b3d-994c-df8f2f1c19d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fae65790-0a19-40ef-8b73-266143c30ffc', 'volume_name': 'volume-fae65790-0a19-40ef-8b73-266143c30ffc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75105562-b923-4934-8489-d7ceaed10424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75105562-b923-4934-8489-d7ceaed10424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea131b7-3fc6-47b4-b495-ca7f99de7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:33 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Volume fae65790-0a19-40ef-8b73-266143c30ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fae65790-0a19-40ef-8b73-266143c30ffc', 'volume_size': 1}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250689398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fae65790-0a19-40ef-8b73-266143c30ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:31Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Creating volume fae65790-0a19-40ef-8b73-266143c30ffc {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:51:33 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:51:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:34 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=83, name=volume-fae65790-0a19-40ef-8b73-266143c30ffc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:51:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc 1073741824" returned: 0 in 1.288s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (ba1444f8-a308-4cf8-aa64-beab0c8d03a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9d2506-94fd-4f2e-a3e4-f5bd95d1e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (6bfac9be-ae27-48bc-b6cf-cb6a6908b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ca09da-4566-4074-ad29-3c94a8251b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ca09da-4566-4074-ad29-3c94a8251b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891133809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad6a782-1e37-4166-be1b-331be7458055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:35Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3eacb-b058-47ea-bf4b-f4f8b4e1dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3eacb-b058-47ea-bf4b-f4f8b4e1dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2da85a-1951-4f0b-b2d6-7bfe74c3d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2da85a-1951-4f0b-b2d6-7bfe74c3d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad6a782-1e37-4166-be1b-331be7458055', 'volume_name': 'volume-cad6a782-1e37-4166-be1b-331be7458055', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f6930b-de68-4cb1-a4c8-6a7054383d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f6930b-de68-4cb1-a4c8-6a7054383d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3fc7e0-692e-49b7-9e10-644c7baa74fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Volume cad6a782-1e37-4166-be1b-331be7458055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad6a782-1e37-4166-be1b-331be7458055', 'volume_size': 1}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (0a37b31c-7dc3-445c-b6fe-be4a4caa3ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e15e1b-196c-486b-8ccc-1aa906228087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b9d2506-94fd-4f2e-a3e4-f5bd95d1e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-966536228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ecea8-368e-409d-8842-a4f71e9978e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:33Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72000510-6456-4261-95fa-ce0117a312e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72000510-6456-4261-95fa-ce0117a312e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9c73a-e28d-49e7-a70e-5341de652879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9c73a-e28d-49e7-a70e-5341de652879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4ecea8-368e-409d-8842-a4f71e9978e5', 'volume_name': 'volume-3a4ecea8-368e-409d-8842-a4f71e9978e5', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09877070-11f8-4037-8a58-1e5e3274ec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09877070-11f8-4037-8a58-1e5e3274ec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8072abd1-6af1-4b99-94ca-b422ed82ebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Volume 3a4ecea8-368e-409d-8842-a4f71e9978e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4ecea8-368e-409d-8842-a4f71e9978e5', 'volume_size': 1}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e15e1b-196c-486b-8ccc-1aa906228087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060650005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c33318-e883-4bc8-9ba2-4a30efb4a989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:34Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7346226c-6887-45b1-8098-340f2813f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7346226c-6887-45b1-8098-340f2813f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432d8a0f-52ca-4333-8dc5-1d5c4c36d292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432d8a0f-52ca-4333-8dc5-1d5c4c36d292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c33318-e883-4bc8-9ba2-4a30efb4a989', 'volume_name': 'volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc14179e-6e0d-4673-b2e8-1a0831656c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc14179e-6e0d-4673-b2e8-1a0831656c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2ddf49-f13e-40d1-b4f2-aa42427eb7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:35 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Volume f2c33318-e883-4bc8-9ba2-4a30efb4a989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989', 'volume_size': 1}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc" returned: 0 in 1.149s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] <== create_volume: return (2563ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.236s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891133809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad6a782-1e37-4166-be1b-331be7458055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:35Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Creating volume cad6a782-1e37-4166-be1b-331be7458055 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:51:35 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:51:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:36 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=84, name=volume-cad6a782-1e37-4166-be1b-331be7458055, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea131b7-3fc6-47b4-b495-ca7f99de7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fae65790-0a19-40ef-8b73-266143c30ffc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dd264b-e1cc-410f-86ed-262eac438481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:36 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (8f5dcafd-6529-45c5-840a-b0d9380358c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87590b85-ff78-4510-9e59-ebb7fb26933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Volume volume-fae65790-0a19-40ef-8b73-266143c30ffc (fae65790-0a19-40ef-8b73-266143c30ffc): created successfully
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52dd264b-e1cc-410f-86ed-262eac438481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (5ea5f7de-90d7-4588-896e-ad5df810db6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055 1073741824" returned: 0 in 0.825s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87590b85-ff78-4510-9e59-ebb7fb26933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-316435418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef733116-37fb-4e37-b2bb-8a02289bd7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:36Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b078ad-0b4e-463f-9e3c-4b72387a737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b078ad-0b4e-463f-9e3c-4b72387a737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3428270c-1de7-44f3-b011-406c2ae5154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3428270c-1de7-44f3-b011-406c2ae5154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef733116-37fb-4e37-b2bb-8a02289bd7f6', 'volume_name': 'volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591f4f8d-1cfb-4ff6-8c97-e90808ebe4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591f4f8d-1cfb-4ff6-8c97-e90808ebe4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92510c8-ac31-4989-8532-e73ecdd6872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Volume ef733116-37fb-4e37-b2bb-8a02289bd7f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6', 'volume_size': 1}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055" returned: 0 in 0.817s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] <== create_volume: return (1802ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8de13fc5-a8df-4732-a5ed-bdffa332d51d tempest-CreateVolumesFromImageTest-491379010 None] Created volume successfully.
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-966536228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4ecea8-368e-409d-8842-a4f71e9978e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:33Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Creating volume 3a4ecea8-368e-409d-8842-a4f71e9978e5 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:51:37 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:51:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:38 devstack quobyte-client[83654]: System call of process 94933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:51:38 devstack quobyte-client[83654]: System call of process 94933 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:51:38 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=85, name=volume-3a4ecea8-368e-409d-8842-a4f71e9978e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3fc7e0-692e-49b7-9e10-644c7baa74fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad6a782-1e37-4166-be1b-331be7458055', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd5774d-be72-49e9-81b0-b56e74cf3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:38 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Volume volume-cad6a782-1e37-4166-be1b-331be7458055 (cad6a782-1e37-4166-be1b-331be7458055): created successfully
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd5774d-be72-49e9-81b0-b56e74cf3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (6bfac9be-ae27-48bc-b6cf-cb6a6908b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5 1073741824" returned: 0 in 0.737s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0402c1e2-426e-41e9-aba8-39d69c1cff91 tempest-CreateVolumesFromImageTest-491379010 None] Created volume successfully.
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5" returned: 0 in 0.296s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] <== create_volume: return (1072ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:51:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.139s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2060650005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c33318-e883-4bc8-9ba2-4a30efb4a989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:34Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Creating volume f2c33318-e883-4bc8-9ba2-4a30efb4a989 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:51:39 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:39 devstack quobyte-client[83654]: System call of process 94937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:51:39 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=86, name=volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8072abd1-6af1-4b99-94ca-b422ed82ebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4ecea8-368e-409d-8842-a4f71e9978e5', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520d307f-68bf-4275-89e8-025f036577d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:39 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Volume volume-3a4ecea8-368e-409d-8842-a4f71e9978e5 (3a4ecea8-368e-409d-8842-a4f71e9978e5): created successfully
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520d307f-68bf-4275-89e8-025f036577d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (ba1444f8-a308-4cf8-aa64-beab0c8d03a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-005a9670-cd55-45e4-b7cf-8d5b644cd836 tempest-CreateVolumesFromImageTest-491379010 None] Created volume successfully.
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989 1073741824" returned: 0 in 0.650s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989" returned: 0 in 0.331s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] <== create_volume: return (1063ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-316435418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef733116-37fb-4e37-b2bb-8a02289bd7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f1eba41b7a4589a93bad5b8ba22f93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:36Z,use_quota=True,user_id='0093aed572144c769def4505fb761ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Creating volume ef733116-37fb-4e37-b2bb-8a02289bd7f6 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:51:40 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:40 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=87, name=volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2ddf49-f13e-40d1-b4f2-aa42427eb7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a4ada7-4116-45c9-bb1e-ce0fad3f2e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6 1073741824" returned: 0 in 0.517s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:41 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Volume volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989 (f2c33318-e883-4bc8-9ba2-4a30efb4a989): created successfully
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a4ada7-4116-45c9-bb1e-ce0fad3f2e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (0a37b31c-7dc3-445c-b6fe-be4a4caa3ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6" returned: 0 in 0.502s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] <== create_volume: return (1057ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9db6b7be-b58f-4736-aa47-36527fbf021b tempest-CreateVolumesFromImageTest-491379010 None] Created volume successfully.
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92510c8-ac31-4989-8532-e73ecdd6872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0182a197-2d22-4cd0-843d-0d55c741b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:51:41 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Volume volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6 (ef733116-37fb-4e37-b2bb-8a02289bd7f6): created successfully
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0182a197-2d22-4cd0-843d-0d55c741b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:51:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Flow 'volume_create_manager' (8f5dcafd-6529-45c5-840a-b0d9380358c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:51:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-72241fae-dd13-44e6-aa04-783a541b7017 tempest-CreateVolumesFromImageTest-491379010 None] Created volume successfully.
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-ef733116-37fb-4e37-b2bb-8a02289bd7f6-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-ef733116-37fb-4e37-b2bb-8a02289bd7f6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-quobyte-ef733116-37fb-4e37-b2bb-8a02289bd7f6" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-ef733116-37fb-4e37-b2bb-8a02289bd7f6" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[94185260-32f5-48c0-a865-6d477571d193]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6" returned: 0 in 0.465s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ef733116-37fb-4e37-b2bb-8a02289bd7f6" returned: 0 in 0.094s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-ef733116-37fb-4e37-b2bb-8a02289bd7f6" released by "delete_volume" :: held 0.739s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Created reservations ['1e4f191b-3718-476f-8778-4580e9b2512b', '4f818804-c5eb-4240-9f4a-9ff80f175ff9', '0f19b25b-4026-4077-946e-5b416788f11d', '446c9b82-0436-4451-8b66-19995c5be818'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.094s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Deleted volume successfully.
Sep 17 07:51:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cfa6a85c-4ea8-473a-8310-90f5f5e69128 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-ef733116-37fb-4e37-b2bb-8a02289bd7f6-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-cad6a782-1e37-4166-be1b-331be7458055-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-cad6a782-1e37-4166-be1b-331be7458055-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-quobyte-cad6a782-1e37-4166-be1b-331be7458055" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-cad6a782-1e37-4166-be1b-331be7458055" acquired by "delete_volume" :: waited 0.018s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:44 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2dab40-2e85-40a3-aec4-e2d1f6afb414]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:51:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055" returned: 0 in 0.420s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cad6a782-1e37-4166-be1b-331be7458055" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-cad6a782-1e37-4166-be1b-331be7458055" released by "delete_volume" :: held 0.907s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:45 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Created reservations ['56e65ffc-e8dd-40cb-873e-8f3b7fe37aae', '10b8a926-f82b-476e-a90d-e630d045b462', '1260e2bf-09a9-4edb-bae1-18ee778cfc35', '0f430cf0-5cdc-44a4-aede-dbe8f0c14d6f'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.165s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:46 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Deleted volume successfully.
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b2212bc-c88e-4ef7-8d40-ac10ee464d28 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-cad6a782-1e37-4166-be1b-331be7458055-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.377s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:46 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-f2c33318-e883-4bc8-9ba2-4a30efb4a989-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-f2c33318-e883-4bc8-9ba2-4a30efb4a989-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-quobyte-f2c33318-e883-4bc8-9ba2-4a30efb4a989" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-f2c33318-e883-4bc8-9ba2-4a30efb4a989" acquired by "delete_volume" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c079255e-d80e-4929-835b-858821629a81]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989" returned: 0 in 0.473s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f2c33318-e883-4bc8-9ba2-4a30efb4a989" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-f2c33318-e883-4bc8-9ba2-4a30efb4a989" released by "delete_volume" :: held 0.797s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Created reservations ['b4d7641d-f7b2-4d13-b3ec-cd6f0c9911db', '5b49c452-ec54-4f56-8166-a3f33316b2ad', 'f3601021-7760-47a8-98ca-2f1861fd1cd2', '3f19cc60-2cc0-4adb-88b6-21eaaddc9b58'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.108s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Deleted volume successfully.
Sep 17 07:51:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-271e069b-e560-453b-8678-6526abeeefa5 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-f2c33318-e883-4bc8-9ba2-4a30efb4a989-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-3a4ecea8-368e-409d-8842-a4f71e9978e5-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-3a4ecea8-368e-409d-8842-a4f71e9978e5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-quobyte-3a4ecea8-368e-409d-8842-a4f71e9978e5" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-3a4ecea8-368e-409d-8842-a4f71e9978e5" acquired by "delete_volume" :: waited 0.018s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[228a6d3a-4b9a-4e50-a329-11e30a3499f0]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:51:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5" returned: 0 in 0.630s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3a4ecea8-368e-409d-8842-a4f71e9978e5" returned: 0 in 0.129s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-3a4ecea8-368e-409d-8842-a4f71e9978e5" released by "delete_volume" :: held 0.945s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Created reservations ['2c7d2e8d-cb82-4434-a60e-f9669bf8faf8', '522ad144-f6c9-41f4-9e42-495397e1c6ea', 'd6adf01d-e9da-485d-8752-7987e050f829', '495bf7e4-b2bb-4551-b925-d6eab81b3332'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.120s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:51 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:51 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Deleted volume successfully.
Sep 17 07:51:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9cb2f285-5fa5-4a55-b006-6169ef5a7e99 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-3a4ecea8-368e-409d-8842-a4f71e9978e5-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-fae65790-0a19-40ef-8b73-266143c30ffc-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-fae65790-0a19-40ef-8b73-266143c30ffc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:52 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "cinder-quobyte-fae65790-0a19-40ef-8b73-266143c30ffc" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-fae65790-0a19-40ef-8b73-266143c30ffc" acquired by "delete_volume" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:52 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c3bb02-3e21-4a85-b8b7-f2b41e586f9d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:51:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc" returned: 0 in 0.620s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fae65790-0a19-40ef-8b73-266143c30ffc" returned: 0 in 0.340s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-6c8bd311-2398-4764-bdd8-75d3826b86b3 req-0b19782b-dec9-4d27-8638-7cca622ebe95 tempest-TestMinimumBasicScenario-1621701283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-quobyte-fae65790-0a19-40ef-8b73-266143c30ffc" released by "delete_volume" :: held 1.412s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-6c8bd311-2398-4764-bdd8-75d3826b86b3 req-0b19782b-dec9-4d27-8638-7cca622ebe95 tempest-TestMinimumBasicScenario-1621701283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-6c8bd311-2398-4764-bdd8-75d3826b86b3 req-0b19782b-dec9-4d27-8638-7cca622ebe95 tempest-TestMinimumBasicScenario-1621701283 None] Terminate volume connection completed successfully.
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-6c8bd311-2398-4764-bdd8-75d3826b86b3 req-0b19782b-dec9-4d27-8638-7cca622ebe95 tempest-TestMinimumBasicScenario-1621701283 None] Deleting attachment d28c6d7b-1fe3-46e2-9f54-27d451ecb6fe. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Created reservations ['43819049-7cf8-4b88-8178-5546063c54ed', '49c3388a-ce8c-4cb8-b829-7c8c63e69249', '0a680b06-3863-421c-9b52-85a70b012246', '2e3e5e7d-49a1-4b2a-8d42-455c1206c213'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.118s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:54 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:54 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Deleted volume successfully.
Sep 17 07:51:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2cf99bc0-b45d-42cc-a59c-3c86004c6332 tempest-CreateVolumesFromImageTest-491379010 None] Lock "cinder-fae65790-0a19-40ef-8b73-266143c30ffc-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Acquiring lock "cinder-dc299498-5cb8-42f7-8c21-6ca5a9a6574e-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Lock "cinder-dc299498-5cb8-42f7-8c21-6ca5a9a6574e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:51:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Acquiring lock "cinder-quobyte-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:51:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Lock "cinder-quobyte-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" acquired by "delete_volume" :: waited 0.034s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:51:55 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8daa2e-4e1c-4266-89a3-cf2bb9d86b40]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:51:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" returned: 0 in 0.614s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" returned: 0 in 0.123s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Lock "cinder-quobyte-dc299498-5cb8-42f7-8c21-6ca5a9a6574e" released by "delete_volume" :: held 1.039s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:51:56 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Created reservations ['450df20e-cc4f-4243-9a1b-8ee10c4f1d57', '4655b9e6-c262-4878-9d96-c87ba1c01111', 'ff72d1d5-ae59-4bad-aba3-0fa602124425', 'e670f7bb-0a50-4115-a6ec-4c0a30b0136b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.187s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:51:57 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Deleted volume successfully.
Sep 17 07:51:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed0acf1f-ff8a-4280-b263-abec5cda83e7 tempest-TestMinimumBasicScenario-1621701283 None] Lock "cinder-dc299498-5cb8-42f7-8c21-6ca5a9a6574e-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Flow 'volume_create_manager' (3f7b6b00-7880-40aa-ba91-6048deb1a9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024aaca2-6316-41ce-a8d6-4a38db5d0463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024aaca2-6316-41ce-a8d6-4a38db5d0463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9b97f2-1653-46ef-a117-d5c77b9ba7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e656ee3e394ca0a261e2ffdb172cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:05Z,use_quota=True,user_id='21836afc48e44bc2a0808520baaccc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1e7a0a-5f24-411e-a888-de2dc0f1f902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da1e7a0a-5f24-411e-a888-de2dc0f1f902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2da147a-45c7-499b-bacd-875c830e71f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2da147a-45c7-499b-bacd-875c830e71f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a9b97f2-1653-46ef-a117-d5c77b9ba7c0', 'volume_name': 'volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0', 'volume_size': 1, 'image_id': 'f18037bb-97ca-4e91-be93-872586e01906', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f979f322170a11bd208824781219622', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61e656ee3e394ca0a261e2ffdb172cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2454f10b0cbdc98e15cac65a1aeff63e6be8dec03660999accb231f41cf71e5ef4bfee94b1ef81fca0543434b8f6f308dd93b473689bd9cecbff1eddd26c357', 'id': 'f18037bb-97ca-4e91-be93-872586e01906', 'created_at': datetime.datetime(2025, 9, 17, 5, 52, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 52, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f18037bb-97ca-4e91-be93-872586e01906/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c86352140>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e019a0-5063-420e-bc8c-cc642aeadd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e019a0-5063-420e-bc8c-cc642aeadd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37892cc1-e9f7-4a81-af0e-0a7d18c5518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:05 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Volume 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0', 'volume_size': 1, 'image_id': 'f18037bb-97ca-4e91-be93-872586e01906', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f979f322170a11bd208824781219622', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61e656ee3e394ca0a261e2ffdb172cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2454f10b0cbdc98e15cac65a1aeff63e6be8dec03660999accb231f41cf71e5ef4bfee94b1ef81fca0543434b8f6f308dd93b473689bd9cecbff1eddd26c357', 'id': 'f18037bb-97ca-4e91-be93-872586e01906', 'created_at': datetime.datetime(2025, 9, 17, 5, 52, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 52, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f18037bb-97ca-4e91-be93-872586e01906/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c86352140>}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Cloning 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 from image f18037bb-97ca-4e91-be93-872586e01906  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 07:52:05 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Image download 0.00 MB at 0.00 MB/s
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36c85f6-24cb-4cc9-b57c-1bb384a76f5e]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:06 devstack sudo[95077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD
Sep 17 07:52:06 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:52:09 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root
Sep 17 07:52:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD" returned: 0 in 3.847s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:10 devstack sudo[95094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD
Sep 17 07:52:10 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:52:12 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root
Sep 17 07:52:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD" returned: 1 in 3.166s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:52:12 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Temporary image f18037bb-97ca-4e91-be93-872586e01906 is fetched for user 21836afc48e44bc2a0808520baaccc41. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 07:52:13 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d126f1a-0c6b-4901-8a14-c65e9b9ad181]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:13 devstack sudo[95100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD
Sep 17 07:52:13 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:52:14 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=38,cinder:UPDATE=56,cinder:DELETE=7,cinder:INSERT=13 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:52:17 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root
Sep 17 07:52:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD" returned: 0 in 4.915s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:18 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD
Sep 17 07:52:18 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 07:52:20 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD" returned: 1 in 2.950s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9b97f2-1653-46ef-a117-d5c77b9ba7c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e656ee3e394ca0a261e2ffdb172cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:05Z,use_quota=True,user_id='21836afc48e44bc2a0808520baaccc41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Creating volume 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:21 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:21 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=88, name=volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 1073741824" returned: 0 in 0.442s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] <== create_volume: return (669ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:22 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Attempting download of f18037bb-97ca-4e91-be93-872586e01906 ((None, None)) to volume 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 07:52:22 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc8df3-7452-40ff-8978-03b2b615e030]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f18037bb-97ca-4e91-be93-872586e01906_f0brev3e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f18037bb-97ca-4e91-be93-872586e01906_f0brev3e" returned: 0 in 0.608s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f18037bb-97ca-4e91-be93-872586e01906_f0brev3e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f18037bb-97ca-4e91-be93-872586e01906_f0brev3e" returned: 1 in 0.480s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f18037bb-97ca-4e91-be93-872586e01906_f0brev3e' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:52:23 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95824ef-4981-4c64-9834-e8ff2408dd19]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD" returned: 1 in 0.715s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:52:24 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] f18037bb-97ca-4e91-be93-872586e01906 was raw, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 07:52:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:24 devstack quobyte-client[83654]: System call of process 95141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:52:24 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=88, name=volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 0 in 0.223s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f18037bb-97ca-4e91-be93-872586e01906_3up8_qgrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:52:25 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Converted 0.00 MB image at 0.00 MB/s
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:25 devstack quobyte-client[83654]: System call of process 95144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 1G" returned: 0 in 0.140s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fceab88-209d-40d0-ab0d-50bd74f8d006]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 0 in 0.480s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 1 in 0.588s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Downloaded image f18037bb-97ca-4e91-be93-872586e01906 ((None, None)) to volume 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Temporary image f18037bb-97ca-4e91-be93-872586e01906 for user 21836afc48e44bc2a0808520baaccc41 is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Marking volume 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Copying metadata from image f18037bb-97ca-4e91-be93-872586e01906 to 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 07:52:26 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Creating volume glance metadata for volume 7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 backed by image f18037bb-97ca-4e91-be93-872586e01906 with: {'image_id': 'f18037bb-97ca-4e91-be93-872586e01906', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7f979f322170a11bd208824781219622', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 07:52:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37892cc1-e9f7-4a81-af0e-0a7d18c5518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0', 'volume_size': 1, 'image_id': 'f18037bb-97ca-4e91-be93-872586e01906', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f979f322170a11bd208824781219622', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '61e656ee3e394ca0a261e2ffdb172cb6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a2454f10b0cbdc98e15cac65a1aeff63e6be8dec03660999accb231f41cf71e5ef4bfee94b1ef81fca0543434b8f6f308dd93b473689bd9cecbff1eddd26c357', 'id': 'f18037bb-97ca-4e91-be93-872586e01906', 'created_at': datetime.datetime(2025, 9, 17, 5, 52, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 52, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f18037bb-97ca-4e91-be93-872586e01906/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c86352140>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764f4125-e01b-4e97-91df-c4061f812561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Volume volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 (7a9b97f2-1653-46ef-a117-d5c77b9ba7c0): created successfully
Sep 17 07:52:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764f4125-e01b-4e97-91df-c4061f812561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Flow 'volume_create_manager' (3f7b6b00-7880-40aa-ba91-6048deb1a9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c3be7910-567f-4bc2-a7d6-3688c55ca02c tempest-VolumeImageDependencyTests-1787493880 None] Created volume successfully.
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Acquiring lock "cinder-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Lock "cinder-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Acquiring lock "cinder-quobyte-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Lock "cinder-quobyte-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" acquired by "delete_volume" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c15c5a-6e7f-4656-a35a-25d759731006]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 0 in 0.599s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 1 in 0.540s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 07:52:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" returned: 0 in 0.163s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Lock "cinder-quobyte-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0" released by "delete_volume" :: held 1.602s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Created reservations ['4294fdfb-5fbe-49ce-89f2-e9ab1903bf56', 'ac006720-1d4e-46b0-8b2d-b0fb64ef526a', 'eb27f47d-86bb-4b0c-84be-4020808e06fe', 'a17cedca-4fd9-4812-8fe9-210a76c006fd'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.423s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:30 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:52:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Deleted volume successfully.
Sep 17 07:52:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ed3679ef-6235-497b-bf15-fc3a5518f94a tempest-VolumeImageDependencyTests-1787493880 None] Lock "cinder-7a9b97f2-1653-46ef-a117-d5c77b9ba7c0-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=78,cinder:SELECT=46,cinder:DELETE=5,cinder:INSERT=14 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:52:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (7baab5b7-a86e-484d-a00a-08c94952324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a3ec17-ce7d-4f94-bff6-f7cf5ea8d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a3ec17-ce7d-4f94-bff6-f7cf5ea8d211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514040254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edf540e-32cc-4610-8df3-46c7f5710bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:35Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d63d432-be12-4421-a8d1-b1373a38f8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d63d432-be12-4421-a8d1-b1373a38f8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9de2a04-c842-40bb-8d22-8d53b2c3d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9de2a04-c842-40bb-8d22-8d53b2c3d282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9edf540e-32cc-4610-8df3-46c7f5710bb7', 'volume_name': 'volume-9edf540e-32cc-4610-8df3-46c7f5710bb7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbda08b-b2e0-4623-8354-67d801448327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbda08b-b2e0-4623-8354-67d801448327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5aef82-2589-499d-a13e-916a0cbe72b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:35 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume 9edf540e-32cc-4610-8df3-46c7f5710bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9edf540e-32cc-4610-8df3-46c7f5710bb7', 'volume_size': 1}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1514040254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9edf540e-32cc-4610-8df3-46c7f5710bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:35Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating volume 9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:35 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:35 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=89, name=volume-9edf540e-32cc-4610-8df3-46c7f5710bb7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 1073741824" returned: 0 in 0.562s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:36 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Flow 'volume_create_manager' (437bf8f9-5f4f-42fb-a9f4-0655a05316cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e400de-7132-4054-9a42-6173c0f88b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e400de-7132-4054-9a42-6173c0f88b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78dd354-649d-4411-825e-f530ae47a24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c326d1031e46999692ed8609f7da93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:36Z,use_quota=True,user_id='bed90db9f8dd45c5b1f9b67d6e4d71be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f0288b-cd85-4f78-af07-6cfd393bef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f0288b-cd85-4f78-af07-6cfd393bef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e2b347-d536-4a62-9c43-688130beaca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e2b347-d536-4a62-9c43-688130beaca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78dd354-649d-4411-825e-f530ae47a24d', 'volume_name': 'volume-c78dd354-649d-4411-825e-f530ae47a24d', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbee47b-0fd7-46ce-8754-d00a5d82eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbee47b-0fd7-46ce-8754-d00a5d82eebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfef219d-1790-433e-979f-486ca355ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Volume c78dd354-649d-4411-825e-f530ae47a24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78dd354-649d-4411-825e-f530ae47a24d', 'volume_size': 1}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7" returned: 0 in 0.532s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] <== create_volume: return (1164ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78dd354-649d-4411-825e-f530ae47a24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c326d1031e46999692ed8609f7da93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:36Z,use_quota=True,user_id='bed90db9f8dd45c5b1f9b67d6e4d71be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Creating volume c78dd354-649d-4411-825e-f530ae47a24d {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:36 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:36 devstack quobyte-client[83654]: System call of process 95181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:52:36 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=90, name=volume-c78dd354-649d-4411-825e-f530ae47a24d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5aef82-2589-499d-a13e-916a0cbe72b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9edf540e-32cc-4610-8df3-46c7f5710bb7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fb91be-5186-4e29-8336-55c732c7cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:37 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 (9edf540e-32cc-4610-8df3-46c7f5710bb7): created successfully
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fb91be-5186-4e29-8336-55c732c7cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (7baab5b7-a86e-484d-a00a-08c94952324f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d 1073741824" returned: 0 in 0.495s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d23188f1-6895-4f27-9c38-52795e495779 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created volume successfully.
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d" returned: 0 in 0.341s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] <== create_volume: return (874ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfef219d-1790-433e-979f-486ca355ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78dd354-649d-4411-825e-f530ae47a24d', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abbe010-37aa-48ac-8b29-6e7c33eea6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:37 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Volume volume-c78dd354-649d-4411-825e-f530ae47a24d (c78dd354-649d-4411-825e-f530ae47a24d): created successfully
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0abbe010-37aa-48ac-8b29-6e7c33eea6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Flow 'volume_create_manager' (437bf8f9-5f4f-42fb-a9f4-0655a05316cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7381ce39-c592-4cb3-a6a9-d9264449905a tempest-CinderUnicodeTest-476064413 None] Created volume successfully.
Sep 17 07:52:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating offline snapshot 9cca30d3-8a8e-495a-804b-6d608f9169bc of volume 9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c50978-8f45-4906-93f4-10cd64aa4152]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7" returned: 0 in 0.571s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:39 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=91, name=volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc 1G" returned: 0 in 0.561s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:39 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Flow 'volume_create_manager' (82896a17-1e17-4566-9c66-707b9ca7753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88505b0b-71c1-4ae0-a5fc-85e8aacc78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88505b0b-71c1-4ae0-a5fc-85e8aacc78d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1016433562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306b1fa0-1573-41c2-b718-25e7bfbd76dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c326d1031e46999692ed8609f7da93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:39Z,use_quota=True,user_id='bed90db9f8dd45c5b1f9b67d6e4d71be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b43751-2ea0-49f3-bcb3-5f3af6e49995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b43751-2ea0-49f3-bcb3-5f3af6e49995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7659e53-8547-4198-ae4e-ac0c82e1300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7659e53-8547-4198-ae4e-ac0c82e1300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306b1fa0-1573-41c2-b718-25e7bfbd76dd', 'volume_name': 'volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0568bc1c-d4ba-46b7-bf9e-0cd4bb9409f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0568bc1c-d4ba-46b7-bf9e-0cd4bb9409f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412f8478-f623-4ae8-9493-9c6356b84f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:40 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Volume 306b1fa0-1573-41c2-b718-25e7bfbd76dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd', 'volume_size': 1}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img rebase -u -b volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc" returned: 0 in 0.493s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc" returned: 0 in 0.141s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc" returned: 0 in 0.125s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.info" returned: 0 in 0.103s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.info" returned: 0 in 0.139s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1016433562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306b1fa0-1573-41c2-b718-25e7bfbd76dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14c326d1031e46999692ed8609f7da93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:39Z,use_quota=True,user_id='bed90db9f8dd45c5b1f9b67d6e4d71be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Creating volume 306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:40 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:41 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=93, name=volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-051e8eef-87e8-40ad-80d7-998cd64514ee tempest-CreateVolumesFromSnapshotTest-560446829 None] Create snapshot completed successfully
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd 1073741824" returned: 0 in 0.480s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd" returned: 0 in 0.144s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] <== create_volume: return (682ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412f8478-f623-4ae8-9493-9c6356b84f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa38d047-2daf-4aa5-a2bd-d53a7d253ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:41 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Volume volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd (306b1fa0-1573-41c2-b718-25e7bfbd76dd): created successfully
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa38d047-2daf-4aa5-a2bd-d53a7d253ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Flow 'volume_create_manager' (82896a17-1e17-4566-9c66-707b9ca7753d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-89db5981-0d5c-4706-9e66-d298ec516408 tempest-CinderUnicodeTest-476064413 None] Created volume successfully.
Sep 17 07:52:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (b85fc298-d354-4786-b867-a9699e1352dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa6665a-b8ad-434e-b6f3-ea83ea3961f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa6665a-b8ad-434e-b6f3-ea83ea3961f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410868793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5130e17-cc21-41f8-8bcb-24db98ccbff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:43Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af84d2e9-0828-40a6-a440-d7d6110a4fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af84d2e9-0828-40a6-a440-d7d6110a4fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04e5137-97e3-4cb0-a13a-f91bf76682fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04e5137-97e3-4cb0-a13a-f91bf76682fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5130e17-cc21-41f8-8bcb-24db98ccbff1', 'volume_name': 'volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c57fc6d-0144-4e99-b2da-e95d6a712ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c57fc6d-0144-4e99-b2da-e95d6a712ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08c50fc-f219-481c-baec-16bee8bd7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume a5130e17-cc21-41f8-8bcb-24db98ccbff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1', 'volume_size': 1}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Creating offline snapshot 0e4a4103-e96c-4415-ada0-bd605b2852e8 of volume 306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df8c82d-f2bb-4675-83d1-26dd79e213e5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Flow 'volume_create_manager' (0d525a6e-921e-4775-b150-b25e87ce8de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3037bd89-b26e-42a1-9670-5d19f3886cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3037bd89-b26e-42a1-9670-5d19f3886cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-879107141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d267a8-fe7b-475e-9be1-319a06a0e7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8151b17e0a8d49e297257de20d9373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:44Z,use_quota=True,user_id='7a9f64fb965b48b3924f6d68e18009ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f246aa0-29f3-4011-9c5c-5dbf83ee2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f246aa0-29f3-4011-9c5c-5dbf83ee2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1314e05-3f83-4bf0-8176-a329a56224a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1314e05-3f83-4bf0-8176-a329a56224a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d267a8-fe7b-475e-9be1-319a06a0e7e6', 'volume_name': 'volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1922a31-3d81-4e11-aefa-3f0a3ffcdbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1922a31-3d81-4e11-aefa-3f0a3ffcdbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a14ffc0-575d-4f5c-b075-df5f39833338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Volume 05d267a8-fe7b-475e-9be1-319a06a0e7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6', 'volume_size': 1}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (aeeeedc4-ad41-4385-b931-0a9040feb6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29d5bca-8c5a-4f85-a436-e31c52333131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29d5bca-8c5a-4f85-a436-e31c52333131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-356336048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319db9b7-5bd3-4375-aa74-f0881f4916eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:44Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04a7f4c-1b7a-44a7-a179-66de82c3c10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04a7f4c-1b7a-44a7-a179-66de82c3c10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df000a2d-99c9-4256-848a-a4535181e2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df000a2d-99c9-4256-848a-a4535181e2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319db9b7-5bd3-4375-aa74-f0881f4916eb', 'volume_name': 'volume-319db9b7-5bd3-4375-aa74-f0881f4916eb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f60628-fc41-4f78-bec8-9196ad35fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f60628-fc41-4f78-bec8-9196ad35fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b03e37-8e67-44cf-9244-d0d966be807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:44 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume 319db9b7-5bd3-4375-aa74-f0881f4916eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319db9b7-5bd3-4375-aa74-f0881f4916eb', 'volume_size': 1}
Sep 17 07:52:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:45 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (ffe3547a-c75d-4ef9-8ea9-38b2d7d80f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a6cc36-6ece-4b11-b6c6-59e4f36b5aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd" returned: 0 in 1.165s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a6cc36-6ece-4b11-b6c6-59e4f36b5aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2081479024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fa00f2-feb3-4ff1-a8ea-1e06996e4748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:45Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56de08e-b361-43fd-8840-7caba5bd3950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:45 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=94, name=volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f56de08e-b361-43fd-8840-7caba5bd3950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ec685-0361-45f0-a0c1-2738148a3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145ec685-0361-45f0-a0c1-2738148a3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fa00f2-feb3-4ff1-a8ea-1e06996e4748', 'volume_name': 'volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29d3776-68d1-4731-bf71-1b913a5b7e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29d3776-68d1-4731-bf71-1b913a5b7e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795408b7-1356-45c7-b6a9-4401b07d84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:45 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume 95fa00f2-feb3-4ff1-a8ea-1e06996e4748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748', 'volume_size': 1}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 1G" returned: 0 in 0.543s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): qemu-img rebase -u -b volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "qemu-img rebase -u -b volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8" returned: 0 in 0.754s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:46 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (8e9bbd19-19d9-49bf-a01b-efa1bbab7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789166f5-d2e4-468a-b851-2e0b17798189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789166f5-d2e4-468a-b851-2e0b17798189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702963804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e05204-41d7-4659-b686-d9b06ab5a014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:46Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b9e1eb-065e-483d-985e-a5c7e2832109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b9e1eb-065e-483d-985e-a5c7e2832109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174f8f7f-f63c-487f-b3a2-b792e5140b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174f8f7f-f63c-487f-b3a2-b792e5140b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e05204-41d7-4659-b686-d9b06ab5a014', 'volume_name': 'volume-25e05204-41d7-4659-b686-d9b06ab5a014', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67c77a-2b65-4051-8d70-0e0ab7b54561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67c77a-2b65-4051-8d70-0e0ab7b54561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190e0381-497f-4ab5-96b9-c7e1c718ffcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume 25e05204-41d7-4659-b686-d9b06ab5a014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e05204-41d7-4659-b686-d9b06ab5a014', 'volume_size': 1}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8" returned: 0 in 0.785s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.644s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:52:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (67d30bc6-b3f6-49b4-9459-f896245d78f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe157752-0695-4a8d-8348-2c484cce2100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe157752-0695-4a8d-8348-2c484cce2100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823655192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d23cc1-1f03-40ad-ae53-965ec9046d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:46Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5498b-c82c-4662-9a70-32daa3a92586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5498b-c82c-4662-9a70-32daa3a92586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df8b919-111a-4b49-bcfd-68a414f3b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df8b919-111a-4b49-bcfd-68a414f3b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d23cc1-1f03-40ad-ae53-965ec9046d23', 'volume_name': 'volume-87d23cc1-1f03-40ad-ae53-965ec9046d23', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c2f661-cf25-4f30-904a-2d922a9a9fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c2f661-cf25-4f30-904a-2d922a9a9fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51247cc-bb4e-4539-adb5-dffaf2ce2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume 87d23cc1-1f03-40ad-ae53-965ec9046d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d23cc1-1f03-40ad-ae53-965ec9046d23', 'volume_size': 1}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8" returned: 0 in 0.557s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.info" returned: 0 in 0.142s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:52:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.info" returned: 0 in 0.122s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.343s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.446s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-410868793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5130e17-cc21-41f8-8bcb-24db98ccbff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:43Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating volume a5130e17-cc21-41f8-8bcb-24db98ccbff1 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:48 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:48 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=96, name=volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1 1073741824" returned: 0 in 0.414s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0d27b797-583c-40a5-a67c-e1e438817bc7 tempest-CinderUnicodeTest-476064413 None] Create snapshot completed successfully
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-0e4a4103-e96c-4415-ada0-bd605b2852e8-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1" returned: 0 in 0.669s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] <== create_volume: return (1143ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.940s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-879107141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d267a8-fe7b-475e-9be1-319a06a0e7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8151b17e0a8d49e297257de20d9373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:44Z,use_quota=True,user_id='7a9f64fb965b48b3924f6d68e18009ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Creating volume 05d267a8-fe7b-475e-9be1-319a06a0e7e6 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:49 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:49 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=97, name=volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d08c50fc-f219-481c-baec-16bee8bd7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe602931-76e1-4d9e-84f5-090e684f2f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-0e4a4103-e96c-4415-ada0-bd605b2852e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.575s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-quobyte-306b1fa0-1573-41c2-b718-25e7bfbd76dd" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:50 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1 (a5130e17-cc21-41f8-8bcb-24db98ccbff1): created successfully
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe602931-76e1-4d9e-84f5-090e684f2f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (b85fc298-d354-4786-b867-a9699e1352dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 1073741824" returned: 0 in 0.575s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-306b1fa0-1573-41c2-b718-25e7bfbd76dd" acquired by "delete_snapshot" :: waited 0.214s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-quobyte-0e4a4103-e96c-4415-ada0-bd605b2852e8" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1e0f0a15-0901-4c25-938a-5eda68574b46 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created volume successfully.
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-0e4a4103-e96c-4415-ada0-bd605b2852e8" acquired by "_delete_snapshot" :: waited 0.213s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Deleting offline snapshot 0e4a4103-e96c-4415-ada0-bd605b2852e8 of volume 306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] snapshot_file for this snap is: volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6" returned: 0 in 0.468s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] <== create_volume: return (1079ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc334d-da61-464c-b320-67a0eddacf05]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.715s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-356336048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319db9b7-5bd3-4375-aa74-f0881f4916eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:44Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating volume 319db9b7-5bd3-4375-aa74-f0881f4916eb {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:50 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:50 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=98, name=volume-319db9b7-5bd3-4375-aa74-f0881f4916eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a14ffc0-575d-4f5c-b075-df5f39833338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef018e84-350f-4481-8d5c-564db0b38c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb 1073741824" returned: 0 in 0.783s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:51 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Volume volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 (05d267a8-fe7b-475e-9be1-319a06a0e7e6): created successfully
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef018e84-350f-4481-8d5c-564db0b38c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Flow 'volume_create_manager' (0d525a6e-921e-4775-b150-b25e87ce8de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb" returned: 0 in 0.354s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] <== create_volume: return (1160ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8" returned: 0 in 0.997s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.285s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2081479024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fa00f2-feb3-4ff1-a8ea-1e06996e4748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:45Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating volume 95fa00f2-feb3-4ff1-a8ea-1e06996e4748 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:51 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:52:52 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=99, name=volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:52 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-42dd9d79-e079-4651-b519-bc4b5b575a74 tempest-AttachVolumeNegativeTest-516126158 None] Created volume successfully.
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f06b08-52c6-413a-a002-487e561575bf]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b03e37-8e67-44cf-9244-d0d966be807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319db9b7-5bd3-4375-aa74-f0881f4916eb', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13e10b3-92f7-488e-91a2-3552c4f7a80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748 1073741824" returned: 0 in 0.732s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume volume-319db9b7-5bd3-4375-aa74-f0881f4916eb (319db9b7-5bd3-4375-aa74-f0881f4916eb): created successfully
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13e10b3-92f7-488e-91a2-3552c4f7a80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (aeeeedc4-ad41-4385-b931-0a9040feb6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748" returned: 0 in 0.397s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] <== create_volume: return (1156ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd" returned: 0 in 0.866s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.858s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1702963804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e05204-41d7-4659-b686-d9b06ab5a014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:46Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating volume 25e05204-41d7-4659-b686-d9b06ab5a014 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:53 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:53 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=100, name=volume-25e05204-41d7-4659-b686-d9b06ab5a014, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:53 devstack quobyte-client[83654]: System call of process 95257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:52:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-96867185-e19b-4d2f-95ca-3482d61b8b21 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created volume successfully.
Sep 17 07:52:53 devstack quobyte-client[83654]: System call of process 95259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795408b7-1356-45c7-b6a9-4401b07d84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e002d81-bfc1-4c7b-af67-0fbfbc9432a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014 1073741824" returned: 0 in 0.650s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8" returned: 0 in 0.611s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:54 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748 (95fa00f2-feb3-4ff1-a8ea-1e06996e4748): created successfully
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e002d81-bfc1-4c7b-af67-0fbfbc9432a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (ffe3547a-c75d-4ef9-8ea9-38b2d7d80f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014" returned: 0 in 0.463s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] <== create_volume: return (1136ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd.0e4a4103-e96c-4415-ada0-bd605b2852e8" returned: 0 in 0.324s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.424s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1823655192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d23cc1-1f03-40ad-ae53-965ec9046d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949c87673ac84ed5a8fce9e32d5b4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:52:46Z,use_quota=True,user_id='a7c70378eece46a6aef6aa9fd52ea892',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Creating volume 87d23cc1-1f03-40ad-ae53-965ec9046d23 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:52:54 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:54 devstack quobyte-client[83654]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:52:54 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=101, name=volume-87d23cc1-1f03-40ad-ae53-965ec9046d23, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:52:54 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9166b117-9438-446a-9ebf-f93775b7a63b tempest-CreateVolumesFromSnapshotTest-560446829 None] Created volume successfully.
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-0e4a4103-e96c-4415-ada0-bd605b2852e8" released by "_delete_snapshot" :: held 4.140s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190e0381-497f-4ab5-96b9-c7e1c718ffcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e05204-41d7-4659-b686-d9b06ab5a014', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba38753-f786-48a0-928a-99abdce10ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-306b1fa0-1573-41c2-b718-25e7bfbd76dd" released by "delete_snapshot" :: held 4.553s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:54 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume volume-25e05204-41d7-4659-b686-d9b06ab5a014 (25e05204-41d7-4659-b686-d9b06ab5a014): created successfully
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba38753-f786-48a0-928a-99abdce10ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (8e9bbd19-19d9-49bf-a01b-efa1bbab7394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23 1073741824" returned: 0 in 0.720s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e18ad1bf-ee13-4487-b2e9-296e109ee2da tempest-CreateVolumesFromSnapshotTest-560446829 None] Created volume successfully.
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23" returned: 0 in 0.414s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a51247cc-bb4e-4539-adb5-dffaf2ce2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d23cc1-1f03-40ad-ae53-965ec9046d23', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b1f109-c71c-4716-8b73-dc4e3d20b0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:52:55 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume volume-87d23cc1-1f03-40ad-ae53-965ec9046d23 (87d23cc1-1f03-40ad-ae53-965ec9046d23): created successfully
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b1f109-c71c-4716-8b73-dc4e3d20b0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Flow 'volume_create_manager' (67d30bc6-b3f6-49b4-9459-f896245d78f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Created reservations ['ccd364a3-a2e6-4e52-8a9c-9dbdb24e2be2', '16c78c15-a816-47ce-9f3d-accfffb6f0f8', '2030a3b5-0227-42df-9de4-7c5930ca399d', '3737d6d7-7820-470a-85d3-49dcfb6cbd19'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:52:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-78008f5a-0e11-4fc5-aac1-63f85669b0de tempest-CreateVolumesFromSnapshotTest-560446829 None] Created volume successfully.
Sep 17 07:52:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Delete snapshot completed successfully.
Sep 17 07:52:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a07bd477-dfec-4e3f-9624-ae64097716c0 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-0e4a4103-e96c-4415-ada0-bd605b2852e8-delete_snapshot" released by "delete_snapshot" :: held 5.817s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-87d23cc1-1f03-40ad-ae53-965ec9046d23-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-87d23cc1-1f03-40ad-ae53-965ec9046d23-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc4fba9-76ee-4af7-88b6-ec6726a3e6c3]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-87d23cc1-1f03-40ad-ae53-965ec9046d23" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-87d23cc1-1f03-40ad-ae53-965ec9046d23" acquired by "delete_volume" :: waited 0.060s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[08db5f74-1138-49d5-9f0c-dbc7456433f7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-306b1fa0-1573-41c2-b718-25e7bfbd76dd-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6" returned: 0 in 0.733s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-306b1fa0-1573-41c2-b718-25e7bfbd76dd-delete_volume" acquired by "delete_volume" :: waited 0.467s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05aaf137-d5d3-484a-b8d4-4e1deba8de58', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:52:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-quobyte-306b1fa0-1573-41c2-b718-25e7bfbd76dd" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23" returned: 0 in 0.678s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-306b1fa0-1573-41c2-b718-25e7bfbd76dd" acquired by "delete_volume" :: waited 0.392s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-87d23cc1-1f03-40ad-ae53-965ec9046d23" returned: 0 in 0.411s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc90aba-ee7f-44ad-a5dd-58d886873479]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-87d23cc1-1f03-40ad-ae53-965ec9046d23" released by "delete_volume" :: held 1.483s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:58 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-ac88172e-6f79-43e5-8d91-8daeddba67e2 req-9702f701-eb1e-4708-a844-e43b0af3f9c5 tempest-AttachVolumeNegativeTest-516126158 None] attachment_update completed successfully.
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['acdeefcd-e887-4c31-960b-165ed4c349c1', '8ed744e2-89d5-4707-bba6-eed506ae451f', '2249dac9-7bcb-47fe-aaae-1c2cc320c707', '6288b4be-ba62-4a0b-9348-ef18b9a001ce'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd" returned: 0 in 0.629s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-306b1fa0-1573-41c2-b718-25e7bfbd76dd" returned: 0 in 0.203s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-306b1fa0-1573-41c2-b718-25e7bfbd76dd" released by "delete_volume" :: held 1.153s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Created reservations ['d2db2d4c-8d79-41d6-a0f4-74b75f6e6456', 'd3b87423-1772-4752-987c-adaac9d28159', '3a49a84b-6fa6-4d25-b738-45f56497a6f2', '8c4f7445-bd67-4dec-811c-6e41940d5180'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-25e05204-41d7-4659-b686-d9b06ab5a014-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.560s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:52:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleted volume successfully.
Sep 17 07:52:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-25e05204-41d7-4659-b686-d9b06ab5a014-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c53fbda2-1ce3-4f8d-a877-917af7f7f822 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-87d23cc1-1f03-40ad-ae53-965ec9046d23-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-25e05204-41d7-4659-b686-d9b06ab5a014" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-25e05204-41d7-4659-b686-d9b06ab5a014" acquired by "delete_volume" :: waited 0.232s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.264s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b47636-8eed-468b-a158-9a8553c27a03]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:00 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Deleted volume successfully.
Sep 17 07:53:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-c78dd354-649d-4411-825e-f530ae47a24d-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fe453bdd-c7dd-4d2b-8019-bf64c2e11f59 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-306b1fa0-1573-41c2-b718-25e7bfbd76dd-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-c78dd354-649d-4411-825e-f530ae47a24d-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:01 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "cinder-quobyte-c78dd354-649d-4411-825e-f530ae47a24d" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014" returned: 0 in 0.839s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-25e05204-41d7-4659-b686-d9b06ab5a014" returned: 0 in 0.214s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-c78dd354-649d-4411-825e-f530ae47a24d" acquired by "delete_volume" :: waited 0.288s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-25e05204-41d7-4659-b686-d9b06ab5a014" released by "delete_volume" :: held 1.267s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce00f88-7640-48f9-9b25-93c116b458a5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['d6d9183c-fd72-4917-9ab4-5e1a428a7337', 'e6eb29d5-93bd-4ef5-a2f6-4b4a839c7c2d', '8b9f382f-507b-46d2-9c6f-1204eb89e06e', 'ed263b3a-4e55-42b8-a9f7-ae4ea255d810'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d" returned: 0 in 0.874s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.243s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:02 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleted volume successfully.
Sep 17 07:53:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c78dd354-649d-4411-825e-f530ae47a24d" returned: 0 in 0.334s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-quobyte-c78dd354-649d-4411-825e-f530ae47a24d" released by "delete_volume" :: held 1.457s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-97a8da42-5ece-49a6-baef-46c3e9f1e37a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-25e05204-41d7-4659-b686-d9b06ab5a014-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Created reservations ['f74621e8-b0ec-4749-b17f-db76f7533b60', '21a4d996-ed18-4f3c-ad0b-f607417ff7f2', 'e7ab521c-b81e-49b8-bf08-0640be3d1d42', 'b662c316-70ba-41f0-be8a-aa0f75b2e120'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-95fa00f2-feb3-4ff1-a8ea-1e06996e4748-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-95fa00f2-feb3-4ff1-a8ea-1e06996e4748-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-95fa00f2-feb3-4ff1-a8ea-1e06996e4748" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.172s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-95fa00f2-feb3-4ff1-a8ea-1e06996e4748" acquired by "delete_volume" :: waited 0.259s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9dda9-b70e-4969-bc03-42d30af10964]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:03 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Deleted volume successfully.
Sep 17 07:53:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:04 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-63aab6dc-78e8-4e18-8f9f-0c9ce85d0fa1 tempest-CinderUnicodeTest-476064413 None] Lock "cinder-c78dd354-649d-4411-825e-f530ae47a24d-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748" returned: 0 in 0.689s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-95fa00f2-feb3-4ff1-a8ea-1e06996e4748" returned: 0 in 0.276s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-95fa00f2-feb3-4ff1-a8ea-1e06996e4748" released by "delete_volume" :: held 1.291s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['7e23e226-e059-4eac-9584-da4870f0a77f', 'b8cfb271-da82-406d-b9fc-122eeb3ba6b9', '7765fb73-52c9-451f-bd7c-c6db8472041b', 'e9566c5f-d0e9-4b0a-9563-f2d5dc45312d'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.124s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:06 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:06 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleted volume successfully.
Sep 17 07:53:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a95039fe-93e5-4ff6-be4e-3b91a376761e tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-95fa00f2-feb3-4ff1-a8ea-1e06996e4748-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-319db9b7-5bd3-4375-aa74-f0881f4916eb-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-319db9b7-5bd3-4375-aa74-f0881f4916eb-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:07 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-319db9b7-5bd3-4375-aa74-f0881f4916eb" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-319db9b7-5bd3-4375-aa74-f0881f4916eb" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[654796b3-00ec-41ba-bc47-09d973ec352c]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb" returned: 0 in 0.489s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-319db9b7-5bd3-4375-aa74-f0881f4916eb" returned: 0 in 0.213s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-319db9b7-5bd3-4375-aa74-f0881f4916eb" released by "delete_volume" :: held 0.981s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['82d10c3e-d78c-40e2-939a-eff60df9cd26', 'f98a2bce-fc73-4ac6-8c7a-7d88136cba8f', '04304ee2-7182-4c48-91e3-c0fae114592d', '7d697fca-13f9-4778-ba9d-46679678eae7'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.152s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleted volume successfully.
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d976d73e-04ff-4308-845a-ea136f65857a tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-319db9b7-5bd3-4375-aa74-f0881f4916eb-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-a5130e17-cc21-41f8-8bcb-24db98ccbff1-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-a5130e17-cc21-41f8-8bcb-24db98ccbff1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-a5130e17-cc21-41f8-8bcb-24db98ccbff1" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-a5130e17-cc21-41f8-8bcb-24db98ccbff1" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc797a3-4bf2-4c62-a0dd-ea3b5f990890]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:10 devstack quobyte-client[83654]: System call of process 95734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:53:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1" returned: 0 in 0.579s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a5130e17-cc21-41f8-8bcb-24db98ccbff1" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-a5130e17-cc21-41f8-8bcb-24db98ccbff1" released by "delete_volume" :: held 0.911s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:10 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['49e4293f-28c1-400a-8215-dfdaf14a4701', 'c17db052-6280-434a-b35d-0f0cb8934f79', '35cc586f-3e8a-4176-a7a0-1e47d45c68ec', '65b1f640-2d9f-4f38-b99a-6506c8c0da0a'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.139s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleted volume successfully.
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5e4d801-c9c6-4899-a9e3-ba9024718ec1 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-a5130e17-cc21-41f8-8bcb-24db98ccbff1-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-9cca30d3-8a8e-495a-804b-6d608f9169bc-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-9cca30d3-8a8e-495a-804b-6d608f9169bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:11 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-9edf540e-32cc-4610-8df3-46c7f5710bb7" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-9edf540e-32cc-4610-8df3-46c7f5710bb7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-9cca30d3-8a8e-495a-804b-6d608f9169bc" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-9cca30d3-8a8e-495a-804b-6d608f9169bc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleting offline snapshot 9cca30d3-8a8e-495a-804b-6d608f9169bc of volume 9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:53:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] snapshot_file for this snap is: volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:53:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[88333834-1bce-4e51-9b06-22ff8117fe3b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:12 devstack quobyte-client[83654]: System call of process 95739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:53:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc" returned: 0 in 0.495s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9edf540e-32cc-4610-8df3-46c7f5710bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:53:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d440ee-5e6d-408b-9a39-81b00d28cc65]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7" returned: 0 in 0.494s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc" returned: 0 in 0.225s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7.9cca30d3-8a8e-495a-804b-6d608f9169bc" returned: 0 in 0.108s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-9cca30d3-8a8e-495a-804b-6d608f9169bc" released by "_delete_snapshot" :: held 1.696s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-9edf540e-32cc-4610-8df3-46c7f5710bb7" released by "delete_snapshot" :: held 1.737s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:14 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['97402aeb-e0b6-41c9-8bed-b8f3d43204aa', '3e1a50c7-d7d8-4730-8ace-fcc4a5b94e97', '0efeadee-5d80-42b7-a5dd-939e6fe8b9ea', '46409cbd-1369-4adf-8186-dd5eb3cf569a'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:14 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Delete snapshot completed successfully.
Sep 17 07:53:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0a9cbd81-045b-4283-8c96-6dec24a2ea82 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-9cca30d3-8a8e-495a-804b-6d608f9169bc-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-9edf540e-32cc-4610-8df3-46c7f5710bb7-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-9edf540e-32cc-4610-8df3-46c7f5710bb7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=87,cinder:SELECT=74,cinder:INSERT=29,cinder:DELETE=11 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:53:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "cinder-quobyte-9edf540e-32cc-4610-8df3-46c7f5710bb7" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-9edf540e-32cc-4610-8df3-46c7f5710bb7" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1bb54-da8a-4e19-aa1a-bdd4a3ecabfe]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7" returned: 0 in 0.561s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9edf540e-32cc-4610-8df3-46c7f5710bb7" returned: 0 in 0.127s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-quobyte-9edf540e-32cc-4610-8df3-46c7f5710bb7" released by "delete_volume" :: held 0.874s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Created reservations ['7a408b1f-1509-4805-98fb-3666963ef9c0', 'f0f11fe3-7b27-43bb-8542-544a6275200a', '250e958f-f8c9-43c7-a75c-c4b1656df029', '3dd4f64d-8f64-4062-9a67-bb4be4117d96'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.122s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:16 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Deleted volume successfully.
Sep 17 07:53:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d5b38b31-fb2b-4256-8d8e-e81e0a0f1573 tempest-CreateVolumesFromSnapshotTest-560446829 None] Lock "cinder-9edf540e-32cc-4610-8df3-46c7f5710bb7-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:26 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=67,cinder:UPDATE=105,cinder:DELETE=8,cinder:INSERT=17 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:53:27 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:53:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-f6406c1b-85b9-40f1-aa59-9c5a7f86063b req-3bce53d1-1358-443f-ae13-670cadc52fd2 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-f6406c1b-85b9-40f1-aa59-9c5a7f86063b req-3bce53d1-1358-443f-ae13-670cadc52fd2 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-f6406c1b-85b9-40f1-aa59-9c5a7f86063b req-3bce53d1-1358-443f-ae13-670cadc52fd2 tempest-AttachVolumeNegativeTest-516126158 None] Terminate volume connection completed successfully.
Sep 17 07:53:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-f6406c1b-85b9-40f1-aa59-9c5a7f86063b req-3bce53d1-1358-443f-ae13-670cadc52fd2 tempest-AttachVolumeNegativeTest-516126158 None] Deleting attachment 05aaf137-d5d3-484a-b8d4-4e1deba8de58. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:53:36 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Flow 'volume_create_manager' (be4cbffe-52e4-463d-bee8-dd746387c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cb32b4-cd70-44d9-b99d-f14d9a28f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cb32b4-cd70-44d9-b99d-f14d9a28f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-501610670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78763978-a2f9-44d5-9878-fb80d5c91818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6622ca56eef7485880d4682fefea69aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:53:36Z,use_quota=True,user_id='a41996c41a9a4659ac85e70df505706d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be575773-d308-491f-a785-d02cf3d2d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be575773-d308-491f-a785-d02cf3d2d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64d4634-a576-4cf7-8242-33a4cc94337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64d4634-a576-4cf7-8242-33a4cc94337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78763978-a2f9-44d5-9878-fb80d5c91818', 'volume_name': 'volume-78763978-a2f9-44d5-9878-fb80d5c91818', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d668d1-05d8-4616-99b7-6ac0dbeef7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d668d1-05d8-4616-99b7-6ac0dbeef7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daf8b26-a2e7-46c3-900c-213c385826dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Volume 78763978-a2f9-44d5-9878-fb80d5c91818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78763978-a2f9-44d5-9878-fb80d5c91818', 'volume_size': 1}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-501610670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78763978-a2f9-44d5-9878-fb80d5c91818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6622ca56eef7485880d4682fefea69aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:53:36Z,use_quota=True,user_id='a41996c41a9a4659ac85e70df505706d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Creating volume 78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:53:36 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:53:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:36 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=102, name=volume-78763978-a2f9-44d5-9878-fb80d5c91818, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 1073741824" returned: 0 in 0.328s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] <== create_volume: return (484ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.496s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daf8b26-a2e7-46c3-900c-213c385826dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78763978-a2f9-44d5-9878-fb80d5c91818', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd34435e-c2d8-4e2a-bc86-1486d78f722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:37 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Volume volume-78763978-a2f9-44d5-9878-fb80d5c91818 (78763978-a2f9-44d5-9878-fb80d5c91818): created successfully
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd34435e-c2d8-4e2a-bc86-1486d78f722e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:37 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Flow 'volume_create_manager' (be4cbffe-52e4-463d-bee8-dd746387c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:53:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-62e88151-66a6-4eed-9869-736b01e768ae tempest-SnapshotDependencyTests-243013175 None] Created volume successfully.
Sep 17 07:53:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:38 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Creating offline snapshot 490c3e4a-c8fa-4b65-80de-c6a5b469b41a of volume 78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:53:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ba18a-3917-4034-bdc7-a839ac7b85cf]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.422s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:39 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=103, name=volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a 1G" returned: 0 in 0.239s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): qemu-img rebase -u -b volume-78763978-a2f9-44d5-9878-fb80d5c91818 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "qemu-img rebase -u -b volume-78763978-a2f9-44d5-9878-fb80d5c91818 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.190s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:53:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.145s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.info" returned: 0 in 0.166s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.info" returned: 0 in 0.211s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0ae36e8b-c5bb-4939-90c8-e6241818c3e2 tempest-SnapshotDependencyTests-243013175 None] Create snapshot completed successfully
Sep 17 07:53:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Flow 'volume_create_manager' (3a152c7a-8943-4598-9a03-7320ac56c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96f8eab-5434-47a7-9358-3ff64021a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96f8eab-5434-47a7-9358-3ff64021a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e5a0b8-7e82-459c-aa6f-455cae1fd682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6622ca56eef7485880d4682fefea69aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=490c3e4a-c8fa-4b65-80de-c6a5b469b41a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:53:43Z,use_quota=True,user_id='a41996c41a9a4659ac85e70df505706d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af9e548-f3a9-4157-961d-2bf94b253565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af9e548-f3a9-4157-961d-2bf94b253565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4daa2be-d018-46f5-83c2-6731e3657a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4daa2be-d018-46f5-83c2-6731e3657a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0e5a0b8-7e82-459c-aa6f-455cae1fd682', 'volume_name': 'volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682', 'volume_size': 1, 'snapshot_id': '490c3e4a-c8fa-4b65-80de-c6a5b469b41a'}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf033df-9c49-4fed-9f55-7da7dcb41f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf033df-9c49-4fed-9f55-7da7dcb41f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c64b025-f5ce-408e-b7f8-73d6e0be930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Volume b0e5a0b8-7e82-459c-aa6f-455cae1fd682: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682', 'volume_size': 1, 'snapshot_id': '490c3e4a-c8fa-4b65-80de-c6a5b469b41a'}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-quobyte-490c3e4a-c8fa-4b65-80de-c6a5b469b41a-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" by "_create_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-490c3e4a-c8fa-4b65-80de-c6a5b469b41a-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Creating volume b0e5a0b8-7e82-459c-aa6f-455cae1fd682 from snapshot 490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-quobyte-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" by "_copy_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] snapshot: 490c3e4a-c8fa-4b65-80de-c6a5b469b41a, volume: b0e5a0b8-7e82-459c-aa6f-455cae1fd682,  {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a3ac69-e7f1-4275-96b2-4cb9c7f416ef]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.583s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78763978-a2f9-44d5-9878-fb80d5c91818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Creating direct copy from snapshot {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e2737-eee8-4535-b927-a076b5e040be]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.486s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG cinder.utils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 not found in is_blk_device check {{(pid=83645) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 07:53:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:44 devstack quobyte-client[83654]: System call of process 95867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:53:44 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=105, name=volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.117s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.402s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:47 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" returned: 0 in 6.204s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:50 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7479b-f59b-4a8e-952e-047a70213bc5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.625s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Image conversion details: src /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 07:53:51 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Converted 1024.00 MB image at 164.73 MB/s
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" released by "_copy_volume_from_snapshot" :: held 8.469s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-490c3e4a-c8fa-4b65-80de-c6a5b469b41a-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" released by "_create_volume_from_snapshot" :: held 8.526s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.553s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c64b025-f5ce-408e-b7f8-73d6e0be930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682', 'volume_size': 1, 'snapshot_id': '490c3e4a-c8fa-4b65-80de-c6a5b469b41a'}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4961cd14-ff14-49e5-8245-8c9d5cfde9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:53:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Volume volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 (b0e5a0b8-7e82-459c-aa6f-455cae1fd682): created successfully
Sep 17 07:53:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4961cd14-ff14-49e5-8245-8c9d5cfde9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:53:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Flow 'volume_create_manager' (3a152c7a-8943-4598-9a03-7320ac56c69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:53:52 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ec04ce71-3d3d-48ca-a585-103356429254 tempest-SnapshotDependencyTests-243013175 None] Created volume successfully.
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-490c3e4a-c8fa-4b65-80de-c6a5b469b41a-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-490c3e4a-c8fa-4b65-80de-c6a5b469b41a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-quobyte-78763978-a2f9-44d5-9878-fb80d5c91818" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-78763978-a2f9-44d5-9878-fb80d5c91818" acquired by "delete_snapshot" :: waited 0.094s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-quobyte-490c3e4a-c8fa-4b65-80de-c6a5b469b41a" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-490c3e4a-c8fa-4b65-80de-c6a5b469b41a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Deleting offline snapshot 490c3e4a-c8fa-4b65-80de-c6a5b469b41a of volume 78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] snapshot_file for this snap is: volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[54657311-f337-493a-84ed-116c51b42d93]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.487s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78763978-a2f9-44d5-9878-fb80d5c91818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:53:54 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2dacf1-e6d4-420a-ab55-a3676532a9ff]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.415s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.261s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818.490c3e4a-c8fa-4b65-80de-c6a5b469b41a" returned: 0 in 0.102s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-490c3e4a-c8fa-4b65-80de-c6a5b469b41a" released by "_delete_snapshot" :: held 1.569s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-78763978-a2f9-44d5-9878-fb80d5c91818" released by "delete_snapshot" :: held 1.596s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Created reservations ['57acf122-d35d-4aed-a745-b5ec5c1a5072', 'b9733286-4e29-4a6d-8cc5-cb695e24c3be', '7a4f9d2c-83be-4291-8a84-6bc32f5d8d3d', '7990b1d8-838d-46af-906d-5b4368d5a929'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Delete snapshot completed successfully.
Sep 17 07:53:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-aa54fb54-2cf7-4540-9136-cddd6909a9a1 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-490c3e4a-c8fa-4b65-80de-c6a5b469b41a-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-78763978-a2f9-44d5-9878-fb80d5c91818-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-78763978-a2f9-44d5-9878-fb80d5c91818-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-quobyte-78763978-a2f9-44d5-9878-fb80d5c91818" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-78763978-a2f9-44d5-9878-fb80d5c91818" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:57 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4870c8-7f10-45f6-9a74-3ca85aa468a1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.466s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-78763978-a2f9-44d5-9878-fb80d5c91818" returned: 0 in 0.088s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-78763978-a2f9-44d5-9878-fb80d5c91818" released by "delete_volume" :: held 0.747s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Created reservations ['439b4896-6668-4e08-b5b1-3716a7647ded', '83a9bf76-7ac2-4cd5-bc99-9b51e49eee78', '8a97fadd-ad81-47a0-977c-cdfadb74df0a', '8b2033fa-a38d-4bfe-91fa-3084d77ee8e4'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.121s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:53:58 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Deleted volume successfully.
Sep 17 07:53:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6e683466-6b28-4783-bd57-59148aa55086 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-78763978-a2f9-44d5-9878-fb80d5c91818-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:53:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-b0e5a0b8-7e82-459c-aa6f-455cae1fd682-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-b0e5a0b8-7e82-459c-aa6f-455cae1fd682-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:59 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:53:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "cinder-quobyte-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:53:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:53:59 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a337f11-7272-41cc-8a8b-7ebd1f1cc226]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:53:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:54:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" returned: 0 in 0.600s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:54:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:54:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" returned: 0 in 0.120s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:54:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-quobyte-b0e5a0b8-7e82-459c-aa6f-455cae1fd682" released by "delete_volume" :: held 1.010s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Created reservations ['1dfe3dcc-13bf-4a41-a53c-2a93c5c07e65', 'f3f8b0ca-ecbf-41e1-aa95-13d4aa7727bd', 'c4e489d8-7645-4aa9-96b9-0479d950471a', 'd5cc7bb0-a9f9-466b-bc41-7a6d31efc5eb'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.153s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:54:01 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:54:01 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Deleted volume successfully.
Sep 17 07:54:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a421750b-9825-42ef-8c48-9c5b60737d53 tempest-SnapshotDependencyTests-243013175 None] Lock "cinder-b0e5a0b8-7e82-459c-aa6f-455cae1fd682-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:54:11 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=22,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:54:11 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=20,cinder:DELETE=2,cinder:UPDATE=27,cinder:INSERT=9 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.092s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:54:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:55:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Flow 'volume_create_manager' (3eb34aed-0b64-4b83-95e6-f445e84238b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c36c63-3791-4869-8604-db4ecb556089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c36c63-3791-4869-8604-db4ecb556089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2112406896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9561fea9-bc2c-48e1-bdeb-3aecf56fd945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8151b17e0a8d49e297257de20d9373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:27Z,use_quota=True,user_id='7a9f64fb965b48b3924f6d68e18009ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f75506-d7ab-4995-83f9-cdb0c2a0832a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f75506-d7ab-4995-83f9-cdb0c2a0832a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ff71a6-6421-4b4c-98a6-3d0ef7fc8126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ff71a6-6421-4b4c-98a6-3d0ef7fc8126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9561fea9-bc2c-48e1-bdeb-3aecf56fd945', 'volume_name': 'volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263fce20-6d37-4191-b18f-f39f3654dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263fce20-6d37-4191-b18f-f39f3654dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b9a46b-7f5a-4b97-aa57-ab51eaa8c4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:55:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Volume 9561fea9-bc2c-48e1-bdeb-3aecf56fd945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945', 'volume_size': 1}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2112406896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9561fea9-bc2c-48e1-bdeb-3aecf56fd945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8151b17e0a8d49e297257de20d9373d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:27Z,use_quota=True,user_id='7a9f64fb965b48b3924f6d68e18009ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Creating volume 9561fea9-bc2c-48e1-bdeb-3aecf56fd945 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:55:27 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:55:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=106, name=volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 1073741824" returned: 0 in 0.361s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] <== create_volume: return (558ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:55:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:55:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b9a46b-7f5a-4b97-aa57-ab51eaa8c4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:55:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea648525-7422-4d26-8351-dc8aecbdf4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:55:28 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Volume volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 (9561fea9-bc2c-48e1-bdeb-3aecf56fd945): created successfully
Sep 17 07:55:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea648525-7422-4d26-8351-dc8aecbdf4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:55:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Flow 'volume_create_manager' (3eb34aed-0b64-4b83-95e6-f445e84238b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:55:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e0ef68d6-9bb4-45bb-a828-fb66caf953d6 tempest-AttachVolumeNegativeTest-516126158 None] Created volume successfully.
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c30f3-c125-4187-8bb2-56de62f2cc1e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" returned: 0 in 0.388s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.447s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:55:33 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '135e6d17-35a3-47c5-8ee5-577c75b6e705', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 07:55:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:55:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-a0f12a16-1334-40ca-92f2-b30953fb4dca req-b319f5c0-0564-4b2b-947d-66761f1172d4 tempest-AttachVolumeNegativeTest-516126158 None] attachment_update completed successfully.
Sep 17 07:55:44 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:55:44 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=7 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.093s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:55:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:55:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:55:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:56:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-532c4b6d-46fb-452f-bcc6-149effed7af0 req-4c77c962-6960-47b2-9136-9a7a7bafc0df tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-532c4b6d-46fb-452f-bcc6-149effed7af0 req-4c77c962-6960-47b2-9136-9a7a7bafc0df tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:03 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-532c4b6d-46fb-452f-bcc6-149effed7af0 req-4c77c962-6960-47b2-9136-9a7a7bafc0df tempest-AttachVolumeNegativeTest-516126158 None] Terminate volume connection completed successfully.
Sep 17 07:56:03 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-532c4b6d-46fb-452f-bcc6-149effed7af0 req-4c77c962-6960-47b2-9136-9a7a7bafc0df tempest-AttachVolumeNegativeTest-516126158 None] Deleting attachment 135e6d17-35a3-47c5-8ee5-577c75b6e705. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 07:56:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:56:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "cinder-9561fea9-bc2c-48e1-bdeb-3aecf56fd945-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-9561fea9-bc2c-48e1-bdeb-3aecf56fd945-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:16 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "cinder-quobyte-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-quobyte-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[84479cfe-d24d-45c7-8c49-e9773e37f94f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" returned: 0 in 0.411s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-quobyte-9561fea9-bc2c-48e1-bdeb-3aecf56fd945" released by "delete_volume" :: held 0.650s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Created reservations ['6976ff30-73df-4478-a176-46a243458642', '06e0721d-77f0-46cd-9e48-4029caaa88fe', 'c0b50309-b114-4fcb-a90a-24d1c51fdcc0', 'c1fb3dca-da88-4d14-a47f-66a811f4307c'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "cinder-05d267a8-fe7b-475e-9be1-319a06a0e7e6-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.281s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:56:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Deleted volume successfully.
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-05d267a8-fe7b-475e-9be1-319a06a0e7e6-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-362dfd75-3251-422f-b1a9-9abeebd7d6b7 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-9561fea9-bc2c-48e1-bdeb-3aecf56fd945-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "cinder-quobyte-05d267a8-fe7b-475e-9be1-319a06a0e7e6" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-quobyte-05d267a8-fe7b-475e-9be1-319a06a0e7e6" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3491a18d-098d-44ea-9359-cf7696a5f757]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6" returned: 0 in 0.411s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-05d267a8-fe7b-475e-9be1-319a06a0e7e6" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-quobyte-05d267a8-fe7b-475e-9be1-319a06a0e7e6" released by "delete_volume" :: held 0.647s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:18 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Created reservations ['7d1e1d60-ab8d-403d-b3ef-93a7635b2c5e', '7074ba3b-474c-4690-b38d-deb58119079a', 'e0473e27-7e6c-4de7-9880-e6d57694836f', '2314b403-d346-4a50-98ed-82f65e1423aa'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.088s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:56:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Deleted volume successfully.
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7446ca5-cede-43f9-87d7-924f3a8d672a tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-05d267a8-fe7b-475e-9be1-319a06a0e7e6-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "cinder-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:20 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "cinder-quobyte-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-quobyte-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9bef5-d415-466c-be80-e6bf00cc091d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" returned: 0 in 0.403s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" returned: 0 in 0.090s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-quobyte-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb" released by "delete_volume" :: held 0.647s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Created reservations ['8be2e977-a976-4931-ba83-fa51ea1752ac', '2f39fb84-f20f-423e-a9af-b75ae13553c5', 'c9c4ae10-7fc9-4e2f-865b-1950e4aa36f9', 'bba7d5fa-b8e5-4f29-aa58-d93de40aec95'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.089s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:56:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Deleted volume successfully.
Sep 17 07:56:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1c34eb33-306b-4510-89b2-986d0bbce218 tempest-AttachVolumeNegativeTest-516126158 None] Lock "cinder-80d80e0b-2d6c-46bd-8370-81e8dc13a0eb-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Flow 'volume_create_manager' (85cb545c-595b-4f7c-9c6a-1b870da11c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecea45b9-8117-44c0-b559-b30c5ca4f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecea45b9-8117-44c0-b559-b30c5ca4f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1151273072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a69139-3665-41c4-80e1-73b0cdd11132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f71ee3e559b4a668cbf74650f05c99c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:30Z,use_quota=True,user_id='88bc548390c04c7cae236c63f7cef115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b110b929-37ab-44b0-8070-7eefb8a513cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b110b929-37ab-44b0-8070-7eefb8a513cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a65d10-4312-4f96-b365-17376105f196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a65d10-4312-4f96-b365-17376105f196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a69139-3665-41c4-80e1-73b0cdd11132', 'volume_name': 'volume-c9a69139-3665-41c4-80e1-73b0cdd11132', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7958b9-db52-45ce-b42f-032f8a7418e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7958b9-db52-45ce-b42f-032f8a7418e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66c23da-21ae-4907-9eab-3fe3f51648e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Volume c9a69139-3665-41c4-80e1-73b0cdd11132: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a69139-3665-41c4-80e1-73b0cdd11132', 'volume_size': 1}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1151273072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a69139-3665-41c4-80e1-73b0cdd11132,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f71ee3e559b4a668cbf74650f05c99c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:30Z,use_quota=True,user_id='88bc548390c04c7cae236c63f7cef115',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Creating volume c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:56:30 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:30 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=107, name=volume-c9a69139-3665-41c4-80e1-73b0cdd11132, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 1073741824" returned: 0 in 0.426s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] <== create_volume: return (617ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:56:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.630s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66c23da-21ae-4907-9eab-3fe3f51648e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a69139-3665-41c4-80e1-73b0cdd11132', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0599f5-d348-48de-b0f6-e2921b3577de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:31 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Volume volume-c9a69139-3665-41c4-80e1-73b0cdd11132 (c9a69139-3665-41c4-80e1-73b0cdd11132): created successfully
Sep 17 07:56:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0599f5-d348-48de-b0f6-e2921b3577de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Flow 'volume_create_manager' (85cb545c-595b-4f7c-9c6a-1b870da11c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:56:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-c92cd803-cba9-4920-af3e-382b8f47238f req-04f38f03-33d3-46d5-91dc-47c3b48050ee tempest-VolumesSnapshotsTestJSON-789762128 None] Created volume successfully.
Sep 17 07:56:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Creating offline snapshot c56b8519-514e-496b-9357-fc526251fffa of volume c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:56:32 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cb31d-9c3e-466b-a21f-663875fb443c]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132" returned: 0 in 0.445s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:33 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=108, name=volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa 1G" returned: 0 in 0.251s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9a69139-3665-41c4-80e1-73b0cdd11132 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "qemu-img rebase -u -b volume-c9a69139-3665-41c4-80e1-73b0cdd11132 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa" returned: 0 in 0.134s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa" returned: 0 in 0.093s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa" returned: 0 in 0.103s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.info" returned: 0 in 0.086s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:56:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.info" returned: 0 in 0.082s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.521s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-9a56db87-4a17-47bf-ad55-a30f5993967f req-efc3aca0-f795-4bfa-981d-73da4749dadf tempest-VolumesSnapshotsTestJSON-789762128 None] Create snapshot completed successfully
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "cinder-c56b8519-514e-496b-9357-fc526251fffa-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-c56b8519-514e-496b-9357-fc526251fffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:34 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "cinder-quobyte-c9a69139-3665-41c4-80e1-73b0cdd11132" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-quobyte-c9a69139-3665-41c4-80e1-73b0cdd11132" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "cinder-quobyte-c56b8519-514e-496b-9357-fc526251fffa" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-quobyte-c56b8519-514e-496b-9357-fc526251fffa" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Deleting offline snapshot c56b8519-514e-496b-9357-fc526251fffa of volume c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] snapshot_file for this snap is: volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a180fb-97f7-40ed-b441-d67b54bfc877]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa" returned: 0 in 0.363s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a69139-3665-41c4-80e1-73b0cdd11132(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:56:35 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5195ba50-5074-4799-80e4-8f54ab915108]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132" returned: 0 in 0.397s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa" returned: 0 in 0.251s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132.c56b8519-514e-496b-9357-fc526251fffa" returned: 0 in 0.087s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-quobyte-c56b8519-514e-496b-9357-fc526251fffa" released by "_delete_snapshot" :: held 1.389s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-quobyte-c9a69139-3665-41c4-80e1-73b0cdd11132" released by "delete_snapshot" :: held 1.411s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG cinder.quota [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Created reservations ['818a5592-4e14-4d17-a362-27ac5ec8ab7e', '5028caec-67f2-4552-b1af-60e910785a5e', '73913da1-adec-47cf-a0ec-475a7b4f8884', '923e0f83-2da6-4b74-8436-efe2e00776e8'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:56:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Delete snapshot completed successfully.
Sep 17 07:56:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fcf325e6-c7b3-466f-87c6-aba9d193c464 req-9edba4d9-8bbf-4d50-84b5-907de24429ee tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-c56b8519-514e-496b-9357-fc526251fffa-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "cinder-c9a69139-3665-41c4-80e1-73b0cdd11132-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-c9a69139-3665-41c4-80e1-73b0cdd11132-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:37 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "cinder-quobyte-c9a69139-3665-41c4-80e1-73b0cdd11132" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-quobyte-c9a69139-3665-41c4-80e1-73b0cdd11132" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[216f4d16-88a2-42da-9624-7ae7dedbe5ff]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132" returned: 0 in 0.412s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c9a69139-3665-41c4-80e1-73b0cdd11132" returned: 0 in 0.100s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-quobyte-c9a69139-3665-41c4-80e1-73b0cdd11132" released by "delete_volume" :: held 0.664s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG cinder.quota [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Created reservations ['b059e8f4-58e2-4e29-9fd2-82db5e78c181', 'ecf6583f-4821-4ba3-93dc-1f6c86bf615c', '909f071d-4909-4444-9182-43c513e70e70', 'f5449d4a-0fe8-4f9b-9a1c-60353117b4fb'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.188s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG cinder.manager [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:56:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Deleted volume successfully.
Sep 17 07:56:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-fd9256df-d14b-495b-a7c1-f8420854f7d1 req-a803a519-1f8e-424e-a6ca-2a1612933af3 tempest-VolumesSnapshotsTestJSON-789762128 None] Lock "cinder-c9a69139-3665-41c4-80e1-73b0cdd11132-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:41 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Flow 'volume_create_manager' (6aa4601a-d032-4673-a85b-22b655b31d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90fdfbd-dcd4-4f20-8ede-d0a88ad65104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90fdfbd-dcd4-4f20-8ede-d0a88ad65104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1756854831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438e22a3-8c2f-4c69-ba47-a070807272e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='135ec44297b949269fb1e37d35360c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:42Z,use_quota=True,user_id='8558d664777d4b7696af74457e6c978f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da07faea-52be-4660-aeab-534c0f959bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da07faea-52be-4660-aeab-534c0f959bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60bb2f6-f2b4-409d-89b3-56694831d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60bb2f6-f2b4-409d-89b3-56694831d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438e22a3-8c2f-4c69-ba47-a070807272e5', 'volume_name': 'volume-438e22a3-8c2f-4c69-ba47-a070807272e5', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cadf802d-fa16-4c4c-a383-d7c6eef0a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cadf802d-fa16-4c4c-a383-d7c6eef0a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cff4359-0759-4b52-8876-23e4151512d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:42 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Volume 438e22a3-8c2f-4c69-ba47-a070807272e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438e22a3-8c2f-4c69-ba47-a070807272e5', 'volume_size': 1}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1756854831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438e22a3-8c2f-4c69-ba47-a070807272e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='135ec44297b949269fb1e37d35360c92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:42Z,use_quota=True,user_id='8558d664777d4b7696af74457e6c978f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Creating volume 438e22a3-8c2f-4c69-ba47-a070807272e5 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:56:42 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:42 devstack quobyte-client[83654]: System call of process 96975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:56:42 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=110, name=volume-438e22a3-8c2f-4c69-ba47-a070807272e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5 1073741824" returned: 0 in 0.354s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] <== create_volume: return (508ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.519s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cff4359-0759-4b52-8876-23e4151512d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438e22a3-8c2f-4c69-ba47-a070807272e5', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1caf30-5fcd-4062-a0b5-f8bdffed8ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:42 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Volume volume-438e22a3-8c2f-4c69-ba47-a070807272e5 (438e22a3-8c2f-4c69-ba47-a070807272e5): created successfully
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1caf30-5fcd-4062-a0b5-f8bdffed8ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Flow 'volume_create_manager' (6aa4601a-d032-4673-a85b-22b655b31d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:56:42 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-941c7421-1f41-4acd-9f65-7eb651de713e req-9dc0c385-9963-471b-8fc8-6417bd95f3cf tempest-VolumesGetTestJSON-678113114 None] Created volume successfully.
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Acquiring lock "cinder-438e22a3-8c2f-4c69-ba47-a070807272e5-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Lock "cinder-438e22a3-8c2f-4c69-ba47-a070807272e5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:43 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Acquiring lock "cinder-quobyte-438e22a3-8c2f-4c69-ba47-a070807272e5" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Lock "cinder-quobyte-438e22a3-8c2f-4c69-ba47-a070807272e5" acquired by "delete_volume" :: waited 0.010s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feb4472-2ab9-4632-a7c8-c2ba84dd1f4a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5" returned: 0 in 0.384s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-438e22a3-8c2f-4c69-ba47-a070807272e5" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Lock "cinder-quobyte-438e22a3-8c2f-4c69-ba47-a070807272e5" released by "delete_volume" :: held 0.617s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG cinder.quota [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Created reservations ['7c2ae81c-8e2d-458e-a0a7-722efb804774', 'f4147628-d87f-48ed-af3d-3044fe83c32d', '9589adb7-f830-40ff-bb5f-5d840db7c131', '114a2c34-f315-4046-89cf-d807d3993c97'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.082s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG cinder.manager [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:56:44 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Deleted volume successfully.
Sep 17 07:56:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [req-16d3d962-472c-412a-8138-161d4dc01b93 req-3f41a6a4-e9d5-4ed2-ac98-99293adc2391 tempest-VolumesGetTestJSON-678113114 None] Lock "cinder-438e22a3-8c2f-4c69-ba47-a070807272e5-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.115s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:56:54 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Flow 'volume_create_manager' (561a4b53-58ba-48c5-8cda-54ed999f3501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caac5c89-e873-4b5d-ae93-3f4ca298c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caac5c89-e873-4b5d-ae93-3f4ca298c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1317753985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8759e44c-f747-42f0-a901-aa8ff9119b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bc576fc3ef48d48bf879293f5d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:54Z,use_quota=True,user_id='73075d84431c492c9e9b685cb1928782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ad789e-b65e-4529-9422-82db4cf3ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ad789e-b65e-4529-9422-82db4cf3ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd0509b-e068-4e54-9a97-050c01e8854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd0509b-e068-4e54-9a97-050c01e8854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8759e44c-f747-42f0-a901-aa8ff9119b9e', 'volume_name': 'volume-8759e44c-f747-42f0-a901-aa8ff9119b9e', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991f8f1d-662d-41dc-8c29-2c20eff2dbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991f8f1d-662d-41dc-8c29-2c20eff2dbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff795fc5-e0b6-4d27-b476-095a4060dc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:54 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Volume 8759e44c-f747-42f0-a901-aa8ff9119b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8759e44c-f747-42f0-a901-aa8ff9119b9e', 'volume_size': 1}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1317753985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8759e44c-f747-42f0-a901-aa8ff9119b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bc576fc3ef48d48bf879293f5d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:54Z,use_quota=True,user_id='73075d84431c492c9e9b685cb1928782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Creating volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:56:54 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:54 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=111, name=volume-8759e44c-f747-42f0-a901-aa8ff9119b9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e 1073741824" returned: 0 in 0.322s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] <== create_volume: return (476ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:56:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.490s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff795fc5-e0b6-4d27-b476-095a4060dc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8759e44c-f747-42f0-a901-aa8ff9119b9e', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbbf4b2-4c25-484a-a170-f1cc307aeb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:56:55 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Volume volume-8759e44c-f747-42f0-a901-aa8ff9119b9e (8759e44c-f747-42f0-a901-aa8ff9119b9e): created successfully
Sep 17 07:56:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbbf4b2-4c25-484a-a170-f1cc307aeb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:56:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Flow 'volume_create_manager' (561a4b53-58ba-48c5-8cda-54ed999f3501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:56:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-43588737-ae3d-4afc-8f9c-fceeb15878d3 tempest-SnapshotsActionsTest-730098321 None] Created volume successfully.
Sep 17 07:56:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Creating offline snapshot 2c84de1a-b3e8-4f36-a932-d72bb4fee858 of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[96259446-c7dd-40a0-abf8-20f09897c00c]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e" returned: 0 in 0.387s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:57 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=112, name=volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 1G" returned: 0 in 0.270s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.144s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.info" returned: 0 in 0.087s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.info" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.508s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:56:58 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0960ab15-6124-4cf1-b548-e3db0ac4d587 tempest-SnapshotsActionsTest-730098321 None] Create snapshot completed successfully
Sep 17 07:56:59 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Creating offline snapshot f5dff163-e188-4254-97e2-c77fd7860fa0 of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[91285c67-9c87-4e42-a013-9f9f6a36c08c]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.401s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:56:59 devstack quobyte-client[83654]: System call of process 97009 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:56:59 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=114, name=volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 1G" returned: 0 in 0.246s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:56:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0" returned: 0 in 0.124s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0" returned: 0 in 0.101s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.217s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:00 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1952ce92-9f9b-4a07-9928-c4c572662718 tempest-SnapshotsActionsTest-730098321 None] Create snapshot completed successfully
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-f5dff163-e188-4254-97e2-c77fd7860fa0-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-f5dff163-e188-4254-97e2-c77fd7860fa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:01 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-f5dff163-e188-4254-97e2-c77fd7860fa0" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-f5dff163-e188-4254-97e2-c77fd7860fa0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Deleting offline snapshot f5dff163-e188-4254-97e2-c77fd7860fa0 of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] snapshot_file for this snap is: volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb2ed0-e94c-47dc-ab8f-c625c809d6d6]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0" returned: 0 in 0.374s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc8468e-1d67-4924-b7a4-fe10214fa90e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.404s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0" returned: 0 in 0.252s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.f5dff163-e188-4254-97e2-c77fd7860fa0" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-f5dff163-e188-4254-97e2-c77fd7860fa0" released by "_delete_snapshot" :: held 1.408s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" released by "delete_snapshot" :: held 1.432s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:03 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Created reservations ['8b284dbe-959a-4c9e-bc82-c49662f48811', '8e96de4e-2900-42c7-8ce4-132af584a7ba', '669d4fb6-e112-46e0-83fd-c1051b521e84', 'dc1f63e4-80ec-4a74-9c9e-df8e0d4739aa'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:03 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Delete snapshot completed successfully.
Sep 17 07:57:03 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9db33d2e-776c-4059-98b5-aed366a7e70a tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-f5dff163-e188-4254-97e2-c77fd7860fa0-delete_snapshot" released by "delete_snapshot" :: held 1.897s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:03 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:03 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Creating offline snapshot 936a9eda-9bdc-4249-9efb-62a691978c8b of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fb011-7a7a-4783-be35-b59723c39dfb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.404s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:04 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=115, name=volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b 1G" returned: 0 in 0.268s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:04 devstack quobyte-client[83654]: System call of process 97033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b" returned: 0 in 0.155s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:57:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b" returned: 0 in 0.090s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:57:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b" returned: 0 in 0.091s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.344s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3459604f-81e6-4e48-aa7c-192155037f20 tempest-SnapshotsActionsTest-730098321 None] Create snapshot completed successfully
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-936a9eda-9bdc-4249-9efb-62a691978c8b-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-936a9eda-9bdc-4249-9efb-62a691978c8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:06 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-936a9eda-9bdc-4249-9efb-62a691978c8b" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-936a9eda-9bdc-4249-9efb-62a691978c8b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Deleting offline snapshot 936a9eda-9bdc-4249-9efb-62a691978c8b of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] snapshot_file for this snap is: volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[203426c9-0822-4cfe-a7ec-3acb7b21667b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b" returned: 0 in 0.501s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20270cf-bb4c-4912-849e-ee0fe077d237]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.370s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b" returned: 0 in 0.287s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.936a9eda-9bdc-4249-9efb-62a691978c8b" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-936a9eda-9bdc-4249-9efb-62a691978c8b" released by "_delete_snapshot" :: held 1.614s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" released by "delete_snapshot" :: held 1.645s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:08 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Created reservations ['ccdad388-ddfc-46db-90ff-95ea4b3684d5', 'c6bbd3d3-f0ec-4247-9d79-e9bf58ae7adb', '60c3e00f-485d-4502-a324-e29fd686425f', '718504a8-76ea-4427-afa3-5653c6f76ccb'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:08 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Delete snapshot completed successfully.
Sep 17 07:57:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e12f7ecd-5567-4601-b805-02b6c33ec9a8 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-936a9eda-9bdc-4249-9efb-62a691978c8b-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Creating offline snapshot d21f478f-ac12-4db1-be43-b589161e20ef of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:57:09 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ef291f-be60-4d57-96e4-b8a0504c1d8e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:10 devstack quobyte-client[83654]: System call of process 97063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:57:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.526s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:10 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:10 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=116, name=volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:57:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef 1G" returned: 0 in 0.385s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef" returned: 0 in 0.141s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef" returned: 0 in 0.080s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.480s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-08c6b793-c2bd-4db9-84dc-688f119ede84 tempest-SnapshotsActionsTest-730098321 None] Create snapshot completed successfully
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-d21f478f-ac12-4db1-be43-b589161e20ef-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-d21f478f-ac12-4db1-be43-b589161e20ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-d21f478f-ac12-4db1-be43-b589161e20ef" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-d21f478f-ac12-4db1-be43-b589161e20ef" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Deleting offline snapshot d21f478f-ac12-4db1-be43-b589161e20ef of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] snapshot_file for this snap is: volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb5027e-2ff5-4f2a-b656-78162219584a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef" returned: 0 in 0.367s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc2e04-733b-4510-b55f-db6b54c3b3bb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.405s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:13 devstack quobyte-client[83654]: System call of process 97100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef" returned: 0 in 0.208s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.d21f478f-ac12-4db1-be43-b589161e20ef" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-d21f478f-ac12-4db1-be43-b589161e20ef" released by "_delete_snapshot" :: held 1.360s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" released by "delete_snapshot" :: held 1.382s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=48,cinder:INSERT=17,cinder:UPDATE=59,cinder:DELETE=5 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=76,cinder:SELECT=52,cinder:INSERT=15,cinder:DELETE=8 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:57:13 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Created reservations ['9d4ca70e-ca02-41dc-bd0b-69bfdb423295', 'eeed9d1d-d942-4d0e-a08c-7dd69deb53c1', 'd3bfe56c-8a81-46a2-88b5-5452338eee60', 'ec797047-4ced-4e20-a0fd-478131b0df45'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:14 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Delete snapshot completed successfully.
Sep 17 07:57:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1d5d419e-3359-4a32-acc2-fc75b47f5796 tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-d21f478f-ac12-4db1-be43-b589161e20ef-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:14 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Creating offline snapshot bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 07:57:14 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f44f0-23cb-4bea-b769-d6e39d538148]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.377s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:15 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=117, name=volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 1G" returned: 0 in 0.233s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img rebase -u -b volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" returned: 0 in 0.123s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" returned: 0 in 0.088s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" returned: 0 in 0.092s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.172s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:16 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6b704655-aa49-4402-ada1-ac942c47c2e9 tempest-SnapshotsActionsTest-730098321 None] Create snapshot completed successfully
Sep 17 07:57:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-bbc23b5d-33aa-47e8-b3de-4ce8b40728a2-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-bbc23b5d-33aa-47e8-b3de-4ce8b40728a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:16 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Acquiring lock "cinder-quobyte-bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Deleting offline snapshot bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] snapshot_file for this snap is: volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2fb0a-7af8-4883-905b-bb45ec2f4718]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" returned: 0 in 0.387s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87ecec-54c3-462f-947c-95208ebe8975]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.441s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:18 devstack quobyte-client[83654]: System call of process 97123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" returned: 0 in 0.212s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-bbc23b5d-33aa-47e8-b3de-4ce8b40728a2" released by "_delete_snapshot" :: held 1.423s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" released by "delete_snapshot" :: held 1.448s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Created reservations ['d617cb9e-fc2d-40f9-8d6c-71b9f50f73c0', '071d0628-a089-4a00-b27f-04d97804bb35', 'cac29e03-4033-42c8-babd-0bfda0567a2d', 'bf6fe829-ee0a-477d-81ea-18a26d880242'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Delete snapshot completed successfully.
Sep 17 07:57:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-99a78625-35ec-4f4c-b351-f9b95ca9dc1b tempest-SnapshotsActionsTest-1235210456 None] Lock "cinder-bbc23b5d-33aa-47e8-b3de-4ce8b40728a2-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "cinder-2c84de1a-b3e8-4f36-a932-d72bb4fee858-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-2c84de1a-b3e8-4f36-a932-d72bb4fee858-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:19 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "cinder-quobyte-2c84de1a-b3e8-4f36-a932-d72bb4fee858" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-quobyte-2c84de1a-b3e8-4f36-a932-d72bb4fee858" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Deleting offline snapshot 2c84de1a-b3e8-4f36-a932-d72bb4fee858 of volume 8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] snapshot_file for this snap is: volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80b982f-0dea-4699-9014-2606ff7d3f2d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.379s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8759e44c-f747-42f0-a901-aa8ff9119b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa83d7-b568-46d0-9fc1-36065f7d4658]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e" returned: 0 in 0.431s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.209s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e.2c84de1a-b3e8-4f36-a932-d72bb4fee858" returned: 0 in 0.098s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-quobyte-2c84de1a-b3e8-4f36-a932-d72bb4fee858" released by "_delete_snapshot" :: held 1.406s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" released by "delete_snapshot" :: held 1.433s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:21 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Created reservations ['9474966f-7890-4544-955f-e11540f55e30', '2618e0d6-184b-43db-97d7-6fa7a8e6c55b', '12a71cd1-1116-45e4-8ea7-4ccbc3c4ff5e', 'ecf77ea5-e513-46f4-a756-e85e21710779'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Delete snapshot completed successfully.
Sep 17 07:57:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19621320-c4ce-4da2-816d-2b4731b4367e tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-2c84de1a-b3e8-4f36-a932-d72bb4fee858-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "cinder-8759e44c-f747-42f0-a901-aa8ff9119b9e-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-8759e44c-f747-42f0-a901-aa8ff9119b9e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:22 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bded021-7fae-4bf3-82b7-2d266c9c6aa2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e" returned: 0 in 0.381s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8759e44c-f747-42f0-a901-aa8ff9119b9e" returned: 0 in 0.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-quobyte-8759e44c-f747-42f0-a901-aa8ff9119b9e" released by "delete_volume" :: held 0.646s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:22 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Created reservations ['2b4b9644-086d-48c8-99c5-0675b84ae945', 'cb34358d-fecb-4dee-aeb6-adb2ffa45247', 'eb2fdbb7-8019-4c54-9ea2-3e0f0fa32ac6', '869916f6-b007-4c54-b513-81684845ca9f'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:57:23 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Deleted volume successfully.
Sep 17 07:57:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b2b977e3-6a45-4e71-8eeb-cfae697fe3e0 tempest-SnapshotsActionsTest-730098321 None] Lock "cinder-8759e44c-f747-42f0-a901-aa8ff9119b9e-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Flow 'volume_create_manager' (9feb54bf-7168-469f-be06-6d75bfe8264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff55c40-3340-4393-a80e-bcf6ae1402a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff55c40-3340-4393-a80e-bcf6ae1402a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1086505755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b34c23-99f7-4a12-98f8-3ca771061938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f342478bdf34b50aacbc81e84e8a9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:31Z,use_quota=True,user_id='23be7f2f6e2b4756a4deacce0b29f8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc5162a-d710-4292-b2b3-640703cb7dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc5162a-d710-4292-b2b3-640703cb7dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4777e7da-07ba-468b-b3b0-85d98f05133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4777e7da-07ba-468b-b3b0-85d98f05133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b34c23-99f7-4a12-98f8-3ca771061938', 'volume_name': 'volume-34b34c23-99f7-4a12-98f8-3ca771061938', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8412c30-9e08-43c3-83d5-ec04b4bc64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8412c30-9e08-43c3-83d5-ec04b4bc64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e028b562-48c9-446d-8b82-e5805396f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume 34b34c23-99f7-4a12-98f8-3ca771061938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b34c23-99f7-4a12-98f8-3ca771061938', 'volume_size': 1}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1086505755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b34c23-99f7-4a12-98f8-3ca771061938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f342478bdf34b50aacbc81e84e8a9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:31Z,use_quota=True,user_id='23be7f2f6e2b4756a4deacce0b29f8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Creating volume 34b34c23-99f7-4a12-98f8-3ca771061938 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:57:31 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:31 devstack quobyte-client[83654]: System call of process 97150 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:57:31 devstack quobyte-client[83654]: System call of process 97150 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:57:31 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=118, name=volume-34b34c23-99f7-4a12-98f8-3ca771061938, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938 1073741824" returned: 0 in 0.321s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] <== create_volume: return (468ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.479s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e028b562-48c9-446d-8b82-e5805396f445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b34c23-99f7-4a12-98f8-3ca771061938', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c231612-ca96-4834-8c82-95454840361c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:31 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume volume-34b34c23-99f7-4a12-98f8-3ca771061938 (34b34c23-99f7-4a12-98f8-3ca771061938): created successfully
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c231612-ca96-4834-8c82-95454840361c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Flow 'volume_create_manager' (9feb54bf-7168-469f-be06-6d75bfe8264e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:57:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ec426dfa-d232-437c-92fb-11ef7f526862 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Created volume successfully.
Sep 17 07:57:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "cinder-34b34c23-99f7-4a12-98f8-3ca771061938-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "cinder-34b34c23-99f7-4a12-98f8-3ca771061938-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "cinder-quobyte-34b34c23-99f7-4a12-98f8-3ca771061938" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "cinder-quobyte-34b34c23-99f7-4a12-98f8-3ca771061938" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d24401-b1ad-4691-a566-b89be6f214a5]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938" returned: 0 in 0.391s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-34b34c23-99f7-4a12-98f8-3ca771061938" returned: 0 in 0.088s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "cinder-quobyte-34b34c23-99f7-4a12-98f8-3ca771061938" released by "delete_volume" :: held 0.637s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Created reservations ['b715d75f-7eae-4a31-b534-78c7e09a930d', 'f85d0056-8cab-4b93-a6a1-c3397fd0a3b2', '115569dd-710f-42da-b922-1d11b60dda12', '43d72bdb-f98b-42a1-9ff0-b50ddbc73ba7'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:57:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Deleted volume successfully.
Sep 17 07:57:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e760915-5714-422f-930c-6e07f3c554a4 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "cinder-34b34c23-99f7-4a12-98f8-3ca771061938-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Flow 'volume_create_manager' (9c0655bf-0f66-4ce2-b1cc-fc061e50bf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fd74d2-ab94-4a94-8133-a0f4009e0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80fd74d2-ab94-4a94-8133-a0f4009e0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-909173648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8359c56-2d91-4417-80df-3bd9a58decfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f342478bdf34b50aacbc81e84e8a9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:36Z,use_quota=True,user_id='23be7f2f6e2b4756a4deacce0b29f8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1932ee08-7599-472b-8a65-68239a471182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1932ee08-7599-472b-8a65-68239a471182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb75e8f-c22e-4bee-ae35-0515c018e124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb75e8f-c22e-4bee-ae35-0515c018e124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8359c56-2d91-4417-80df-3bd9a58decfd', 'volume_name': 'volume-d8359c56-2d91-4417-80df-3bd9a58decfd', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dd46ac-e72b-444e-b6db-3c5e8e980c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98dd46ac-e72b-444e-b6db-3c5e8e980c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a56614-e464-42d4-b1cc-816789ed1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume d8359c56-2d91-4417-80df-3bd9a58decfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8359c56-2d91-4417-80df-3bd9a58decfd', 'volume_size': 1}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-909173648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8359c56-2d91-4417-80df-3bd9a58decfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f342478bdf34b50aacbc81e84e8a9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:36Z,use_quota=True,user_id='23be7f2f6e2b4756a4deacce0b29f8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Creating volume d8359c56-2d91-4417-80df-3bd9a58decfd {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:57:36 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:36 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=119, name=volume-d8359c56-2d91-4417-80df-3bd9a58decfd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd 1073741824" returned: 0 in 0.327s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd" returned: 0 in 0.082s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a56614-e464-42d4-b1cc-816789ed1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8359c56-2d91-4417-80df-3bd9a58decfd', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bebac5-b5c5-4e1c-b9ed-e60e172f981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Volume volume-d8359c56-2d91-4417-80df-3bd9a58decfd (d8359c56-2d91-4417-80df-3bd9a58decfd): created successfully
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bebac5-b5c5-4e1c-b9ed-e60e172f981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Flow 'volume_create_manager' (9c0655bf-0f66-4ce2-b1cc-fc061e50bf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:57:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f759ec41-fe98-49ed-9fe7-803057b9a768 tempest-VolumeQuotasAdminTestJSON-1030363539 None] Created volume successfully.
Sep 17 07:57:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8b8d655b-01b4-4b48-beec-4f781e695ea8 tempest-VolumeQuotasAdminTestJSON-1915356835 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:38 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8b8d655b-01b4-4b48-beec-4f781e695ea8 tempest-VolumeQuotasAdminTestJSON-1915356835 None] Transfer volume completed successfully.
Sep 17 07:57:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Acquiring lock "cinder-d8359c56-2d91-4417-80df-3bd9a58decfd-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Lock "cinder-d8359c56-2d91-4417-80df-3bd9a58decfd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Acquiring lock "cinder-quobyte-d8359c56-2d91-4417-80df-3bd9a58decfd" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Lock "cinder-quobyte-d8359c56-2d91-4417-80df-3bd9a58decfd" acquired by "delete_volume" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:39 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[738057e1-329f-4036-aa71-304af40dadf7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd" returned: 0 in 0.403s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d8359c56-2d91-4417-80df-3bd9a58decfd" returned: 0 in 0.100s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Lock "cinder-quobyte-d8359c56-2d91-4417-80df-3bd9a58decfd" released by "delete_volume" :: held 0.639s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Created reservations ['139c54ca-5f44-40d7-b491-e32213d161eb', 'd720f2d4-e900-4cee-8f52-f537ed052362', '5774e5bd-598f-4f52-bf92-91b65a736a9a', 'b2cc5e73-dc87-4cdf-8595-defe79ef3139'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.174s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:57:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Deleted volume successfully.
Sep 17 07:57:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1f02990-ad8f-499d-a969-c73463b294b0 tempest-VolumeQuotasAdminTestJSON-919489760 None] Lock "cinder-d8359c56-2d91-4417-80df-3bd9a58decfd-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:57:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Flow 'volume_create_manager' (1d916025-773e-428e-9138-815ff7afee5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba646a85-9482-4e50-9235-1e4cbc03168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba646a85-9482-4e50-9235-1e4cbc03168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-930318765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f75f00-e849-4079-95eb-90fd2a68ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91582b1ac3ed4c8591a6492e4a56dbfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:49Z,use_quota=True,user_id='8eaeb2ae8c7b4a77a2eb4ad7c18fb11f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ccb190-fce6-443d-a7d5-bb67fe7d3bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ccb190-fce6-443d-a7d5-bb67fe7d3bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280b474d-edc0-4a4f-8b0a-b27c54869a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280b474d-edc0-4a4f-8b0a-b27c54869a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f75f00-e849-4079-95eb-90fd2a68ce9f', 'volume_name': 'volume-82f75f00-e849-4079-95eb-90fd2a68ce9f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144eae0a-9c68-4c95-a0b1-6dedeb95c92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144eae0a-9c68-4c95-a0b1-6dedeb95c92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d266aff-793b-48d2-9b36-d4e277892dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:49 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Volume 82f75f00-e849-4079-95eb-90fd2a68ce9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f75f00-e849-4079-95eb-90fd2a68ce9f', 'volume_size': 1}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-930318765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f75f00-e849-4079-95eb-90fd2a68ce9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91582b1ac3ed4c8591a6492e4a56dbfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:49Z,use_quota=True,user_id='8eaeb2ae8c7b4a77a2eb4ad7c18fb11f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Creating volume 82f75f00-e849-4079-95eb-90fd2a68ce9f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:57:49 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:57:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:49 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=120, name=volume-82f75f00-e849-4079-95eb-90fd2a68ce9f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f 1073741824" returned: 0 in 0.328s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f" returned: 0 in 0.096s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] <== create_volume: return (509ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.524s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d266aff-793b-48d2-9b36-d4e277892dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f75f00-e849-4079-95eb-90fd2a68ce9f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ede97cc-c3f7-4dc7-8664-dd6d7b2849b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:57:50 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Volume volume-82f75f00-e849-4079-95eb-90fd2a68ce9f (82f75f00-e849-4079-95eb-90fd2a68ce9f): created successfully
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ede97cc-c3f7-4dc7-8664-dd6d7b2849b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:57:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Flow 'volume_create_manager' (1d916025-773e-428e-9138-815ff7afee5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:57:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e04a1c9d-4b8a-4bda-a02c-fe2fcf36a610 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Created volume successfully.
Sep 17 07:57:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Acquiring lock "cinder-82f75f00-e849-4079-95eb-90fd2a68ce9f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "cinder-82f75f00-e849-4079-95eb-90fd2a68ce9f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:52 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:57:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Acquiring lock "cinder-quobyte-82f75f00-e849-4079-95eb-90fd2a68ce9f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:57:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "cinder-quobyte-82f75f00-e849-4079-95eb-90fd2a68ce9f" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:57:52 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0883693e-929d-4982-8227-9efb318e94b6]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:57:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f" returned: 0 in 0.442s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82f75f00-e849-4079-95eb-90fd2a68ce9f" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "cinder-quobyte-82f75f00-e849-4079-95eb-90fd2a68ce9f" released by "delete_volume" :: held 0.680s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:57:53 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Created reservations ['0df20587-c471-4700-926b-78cc9605e892', 'e4e784fe-0fab-41eb-ba81-c9ba06fd42f3', '0d4d7a19-acd2-49dc-9bfa-aeb6ea16a972', 'c41ad55f-dae4-404f-84f7-b62c2f22e223'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.091s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:57:54 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Deleted volume successfully.
Sep 17 07:57:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f9a6cce4-3f6c-41c9-ac86-eab0091f0614 tempest-VolumeQuotasNegativeTestJSON-941014197 None] Lock "cinder-82f75f00-e849-4079-95eb-90fd2a68ce9f-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:58:04 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=55,cinder:SELECT=38,cinder:DELETE=5,cinder:INSERT=9 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:58:04 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=38,cinder:INSERT=19,cinder:UPDATE=57,cinder:DELETE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:58:45 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:58:45 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (35cbb1af-2f77-4dd6-92cb-ef49a78d99f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7711231f-42f1-4ee7-b9df-7ca6ab4aa7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7711231f-42f1-4ee7-b9df-7ca6ab4aa7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1091970688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1b3e34-9e2d-4077-ae3a-989ff5179e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:46Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749d177f-a266-4bc1-b1e1-93b0bb8ce316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749d177f-a266-4bc1-b1e1-93b0bb8ce316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4e217-3397-4338-8ff4-6288f9978df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e4e217-3397-4338-8ff4-6288f9978df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1b3e34-9e2d-4077-ae3a-989ff5179e4c', 'volume_name': 'volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9205562a-a191-4171-8825-b309f8bc4cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9205562a-a191-4171-8825-b309f8bc4cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598bffc2-b6d2-4ee7-b953-c32d9c19a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:58:46 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Volume 0d1b3e34-9e2d-4077-ae3a-989ff5179e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c', 'volume_size': 1}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1091970688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1b3e34-9e2d-4077-ae3a-989ff5179e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:46Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Creating volume 0d1b3e34-9e2d-4077-ae3a-989ff5179e4c {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:58:46 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:58:46 devstack quobyte-client[83654]: System call of process 97325 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:58:46 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=121, name=volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c 1073741824" returned: 0 in 0.428s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" returned: 0 in 0.277s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] <== create_volume: return (768ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:58:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:58:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.296s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:58:47 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:58:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598bffc2-b6d2-4ee7-b953-c32d9c19a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:58:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26f825d-4636-4dbc-b890-e647306999bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:58:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Volume volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c (0d1b3e34-9e2d-4077-ae3a-989ff5179e4c): created successfully
Sep 17 07:58:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26f825d-4636-4dbc-b890-e647306999bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:58:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (35cbb1af-2f77-4dd6-92cb-ef49a78d99f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:58:47 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-294106d6-5686-4095-bb1c-a320b017dd40 tempest-VolumesActionsTest-715142808 None] Created volume successfully.
Sep 17 07:58:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-43a42370-eb05-421b-9d46-f72a1733b371 tempest-VolumesActionsTest-715142808 None] Acquiring lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" by "attach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:58:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-43a42370-eb05-421b-9d46-f72a1733b371 tempest-VolumesActionsTest-715142808 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" acquired by "attach_volume" :: waited 0.065s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:58:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-43a42370-eb05-421b-9d46-f72a1733b371 tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:58:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-43a42370-eb05-421b-9d46-f72a1733b371 tempest-VolumesActionsTest-715142808 None] Attaching volume 0d1b3e34-9e2d-4077-ae3a-989ff5179e4c to instance 59a1f672-7072-455e-83ef-1c28472eb6aa at mountpoint /dev/vdb on host None.
Sep 17 07:58:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-43a42370-eb05-421b-9d46-f72a1733b371 tempest-VolumesActionsTest-715142808 None] Attach volume completed successfully.
Sep 17 07:58:48 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-43a42370-eb05-421b-9d46-f72a1733b371 tempest-VolumesActionsTest-715142808 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" released by "attach_volume" :: held 0.320s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:58:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:58:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Terminate volume connection completed successfully.
Sep 17 07:58:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-detach_volume" by "detach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:58:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:58:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:58:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Detaching volume 0d1b3e34-9e2d-4077-ae3a-989ff5179e4c from instance 59a1f672-7072-455e-83ef-1c28472eb6aa.
Sep 17 07:58:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:58:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Detach volume completed successfully.
Sep 17 07:58:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c064cdd0-d7a4-4010-81ad-b211cfa015fd tempest-VolumesActionsTest-1878608667 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:58:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-672baa99-6a32-4135-95ed-d85005aa9e6a tempest-VolumesActionsTest-715142808 None] Acquiring lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-detach_volume" by "detach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:58:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-672baa99-6a32-4135-95ed-d85005aa9e6a tempest-VolumesActionsTest-715142808 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:58:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-672baa99-6a32-4135-95ed-d85005aa9e6a tempest-VolumesActionsTest-715142808 None] Volume detach called, but volume not attached.
Sep 17 07:58:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-672baa99-6a32-4135-95ed-d85005aa9e6a tempest-VolumesActionsTest-715142808 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-detach_volume" released by "detach_volume" :: held 0.011s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:58:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Acquiring lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:58:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Acquiring lock "cinder-quobyte-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Lock "cinder-quobyte-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" acquired by "delete_volume" :: waited 0.010s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f38d8f-b5a2-4663-93dd-5e9efc342eb1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" returned: 0 in 0.440s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" returned: 0 in 0.112s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:58:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Lock "cinder-quobyte-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c" released by "delete_volume" :: held 0.715s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Created reservations ['b3091e31-5238-4e8a-87f9-aadfa07ace15', '45cf6df9-960b-435a-83e4-4d454c9a370e', '7597cd04-28b6-4568-b210-9704eb44f1c9', 'cfffa180-580b-4a98-b232-78e452f9c5be'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.119s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:58:52 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Deleted volume successfully.
Sep 17 07:58:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3076e1d1-ce61-4bfb-96a9-cc47b5fe743b tempest-VolumesActionsTest-715142808 None] Lock "cinder-0d1b3e34-9e2d-4077-ae3a-989ff5179e4c-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:01 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:01 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (9ff413eb-a405-4397-8867-deb52a057388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1698599-dab7-4c39-9d0e-bbb66a467023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1698599-dab7-4c39-9d0e-bbb66a467023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77839409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5db833f-6103-4ab2-b62f-ea5a714979fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:02Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce20ddf8-f5c1-46b7-884a-966eb794198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce20ddf8-f5c1-46b7-884a-966eb794198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0648ac-d74c-49bd-b035-e507d9d53969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0648ac-d74c-49bd-b035-e507d9d53969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5db833f-6103-4ab2-b62f-ea5a714979fe', 'volume_name': 'volume-f5db833f-6103-4ab2-b62f-ea5a714979fe', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fa91c5-e39f-4b50-9dd4-2491b8ec6fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fa91c5-e39f-4b50-9dd4-2491b8ec6fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ada2783-2867-46be-b0c9-238c13cadb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:02 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Volume f5db833f-6103-4ab2-b62f-ea5a714979fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5db833f-6103-4ab2-b62f-ea5a714979fe', 'volume_size': 1}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77839409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5db833f-6103-4ab2-b62f-ea5a714979fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:02Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Creating volume f5db833f-6103-4ab2-b62f-ea5a714979fe {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:02 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:02 devstack quobyte-client[83654]: System call of process 97379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:59:02 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=122, name=volume-f5db833f-6103-4ab2-b62f-ea5a714979fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe 1073741824" returned: 0 in 0.327s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] <== create_volume: return (474ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ada2783-2867-46be-b0c9-238c13cadb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5db833f-6103-4ab2-b62f-ea5a714979fe', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ad2f6c-5d6d-4cd2-95d6-c356f23bd799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:02 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Volume volume-f5db833f-6103-4ab2-b62f-ea5a714979fe (f5db833f-6103-4ab2-b62f-ea5a714979fe): created successfully
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ad2f6c-5d6d-4cd2-95d6-c356f23bd799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (9ff413eb-a405-4397-8867-deb52a057388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:02 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-611d927c-2c8d-4e69-9158-df708e22ec3d tempest-VolumesActionsTest-715142808 None] Created volume successfully.
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-f5db833f-6103-4ab2-b62f-ea5a714979fe-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-f5db833f-6103-4ab2-b62f-ea5a714979fe-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-quobyte-f5db833f-6103-4ab2-b62f-ea5a714979fe" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-f5db833f-6103-4ab2-b62f-ea5a714979fe" acquired by "delete_volume" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b6e7e3-a175-4935-80d1-be83134247d9]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe" returned: 0 in 0.415s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f5db833f-6103-4ab2-b62f-ea5a714979fe" returned: 0 in 0.112s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-f5db833f-6103-4ab2-b62f-ea5a714979fe" released by "delete_volume" :: held 0.666s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Created reservations ['82e1e1a4-54da-4992-8064-a4622f403dc8', 'b4defe62-5d4a-4e40-bf6d-d48c774f9c36', '4c1b31fe-4ccc-4d2a-9ed5-608544f3b006', '287d1acd-1f03-481b-b5d5-a58b1ff714af'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:05 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Deleted volume successfully.
Sep 17 07:59:06 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8aa98f24-607e-4a32-9cf4-e7b617ad04a5 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-f5db833f-6103-4ab2-b62f-ea5a714979fe-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:07 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (0476b2b4-f224-4f91-80bb-adf3d2eb9df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22efc812-dca0-4d9d-bb87-577a255d1a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22efc812-dca0-4d9d-bb87-577a255d1a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1328647077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fa6025-c6cf-4efc-a23e-ab698eadf087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:07Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab3040e-8e8e-4af5-9ce1-9917f26e88af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab3040e-8e8e-4af5-9ce1-9917f26e88af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2068352a-519d-4292-8de6-b533de1643e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2068352a-519d-4292-8de6-b533de1643e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fa6025-c6cf-4efc-a23e-ab698eadf087', 'volume_name': 'volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258105f8-0e53-45cc-87ea-b37573af0bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258105f8-0e53-45cc-87ea-b37573af0bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d540ff5-89ca-4713-8963-f84e7740233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:07 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Volume b3fa6025-c6cf-4efc-a23e-ab698eadf087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087', 'volume_size': 1}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1328647077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fa6025-c6cf-4efc-a23e-ab698eadf087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:07Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Creating volume b3fa6025-c6cf-4efc-a23e-ab698eadf087 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:07 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:07 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=123, name=volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:07 devstack quobyte-client[83654]: System call of process 97390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087 1073741824" returned: 0 in 0.311s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087" returned: 0 in 0.179s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] <== create_volume: return (610ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.627s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d540ff5-89ca-4713-8963-f84e7740233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d22068-5cb4-40b0-aabb-2a89a8a476dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:08 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Volume volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087 (b3fa6025-c6cf-4efc-a23e-ab698eadf087): created successfully
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d22068-5cb4-40b0-aabb-2a89a8a476dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (0476b2b4-f224-4f91-80bb-adf3d2eb9df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:08 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a3580c7f-63bf-4729-b976-bb5f92bcb97f tempest-VolumesActionsTest-715142808 None] Created volume successfully.
Sep 17 07:59:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-b3fa6025-c6cf-4efc-a23e-ab698eadf087-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-b3fa6025-c6cf-4efc-a23e-ab698eadf087-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-quobyte-b3fa6025-c6cf-4efc-a23e-ab698eadf087" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-b3fa6025-c6cf-4efc-a23e-ab698eadf087" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:09 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[93406e8a-4c93-455f-a6d4-02c7e8859aab]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087" returned: 0 in 0.407s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b3fa6025-c6cf-4efc-a23e-ab698eadf087" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-b3fa6025-c6cf-4efc-a23e-ab698eadf087" released by "delete_volume" :: held 0.646s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Created reservations ['69a4ded3-afa7-4525-8555-648d03ea5765', '5d160988-5f53-4a05-8839-ff890b83b4ef', 'a610e8aa-45f5-4c20-9f1f-eafb10fa6da1', '042cc6aa-d86d-4697-a3c9-19825d3daaa6'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.090s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:10 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Deleted volume successfully.
Sep 17 07:59:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-bba954ee-c4f0-4390-bd1e-c67e1056a677 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-b3fa6025-c6cf-4efc-a23e-ab698eadf087-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (43a8fc2f-dd80-4d21-b240-3d8264511af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f85748f-72e8-444b-a92c-202a2fd28641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f85748f-72e8-444b-a92c-202a2fd28641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1037126127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b45e4f3-db38-4c70-bca1-480eb68cc2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:12Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f2a8fb-2cd7-409e-9d07-92a78c773130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f2a8fb-2cd7-409e-9d07-92a78c773130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc8b08a-7c85-4757-acba-8e56acf374cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc8b08a-7c85-4757-acba-8e56acf374cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b45e4f3-db38-4c70-bca1-480eb68cc2b2', 'volume_name': 'volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159e85f0-8a5e-4227-9348-94b20af78fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159e85f0-8a5e-4227-9348-94b20af78fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4275e6fa-6090-4068-a059-07e14c2fb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:12 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Volume 7b45e4f3-db38-4c70-bca1-480eb68cc2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2', 'volume_size': 1}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1037126127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b45e4f3-db38-4c70-bca1-480eb68cc2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:12Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Creating volume 7b45e4f3-db38-4c70-bca1-480eb68cc2b2 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:12 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:12 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=124, name=volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2 1073741824" returned: 0 in 0.364s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] <== create_volume: return (515ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.528s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4275e6fa-6090-4068-a059-07e14c2fb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a192b67-71fd-40a1-a240-1fd827df374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:13 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Volume volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2 (7b45e4f3-db38-4c70-bca1-480eb68cc2b2): created successfully
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a192b67-71fd-40a1-a240-1fd827df374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (43a8fc2f-dd80-4d21-b240-3d8264511af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c678a7e4-b5c2-42b2-9219-eaa4624db768 tempest-VolumesActionsTest-715142808 None] Created volume successfully.
Sep 17 07:59:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-7b45e4f3-db38-4c70-bca1-480eb68cc2b2-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-7b45e4f3-db38-4c70-bca1-480eb68cc2b2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-quobyte-7b45e4f3-db38-4c70-bca1-480eb68cc2b2" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-7b45e4f3-db38-4c70-bca1-480eb68cc2b2" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50385ca-cf4e-4a9a-be22-1dfa43967d93]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2" returned: 0 in 0.413s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7b45e4f3-db38-4c70-bca1-480eb68cc2b2" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-7b45e4f3-db38-4c70-bca1-480eb68cc2b2" released by "delete_volume" :: held 0.658s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Created reservations ['446b2302-3eef-4f24-a855-d3640b01fe16', 'd0a21666-e7c2-4dc5-8040-9f1f1bec3449', '209b5328-9046-49a3-bb3f-c08a5ea57ddf', 'fe1282b8-4364-4b3e-8685-11a361944d86'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.091s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:16 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Deleted volume successfully.
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-26780911-cf18-45d5-afde-26d0af1a8ba4 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-7b45e4f3-db38-4c70-bca1-480eb68cc2b2-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (28ddf9d1-1f64-4b54-a8e0-db1e96ea0d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58c374c-9073-4046-bef7-db88b81ee53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58c374c-9073-4046-bef7-db88b81ee53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2122425736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d89ad8-eb21-4da5-b347-6edf4061c22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:18Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a9a7a9-7daa-421c-86b4-92dc49df493b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a9a7a9-7daa-421c-86b4-92dc49df493b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c3babe-8f90-4d61-8fb8-a2b506cf18b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c3babe-8f90-4d61-8fb8-a2b506cf18b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d89ad8-eb21-4da5-b347-6edf4061c22f', 'volume_name': 'volume-17d89ad8-eb21-4da5-b347-6edf4061c22f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441a7b1b-eeab-4c14-be2c-603a211747d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441a7b1b-eeab-4c14-be2c-603a211747d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb8a0e0-32b5-4001-87ec-63101f1ff27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:17 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Volume 17d89ad8-eb21-4da5-b347-6edf4061c22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d89ad8-eb21-4da5-b347-6edf4061c22f', 'volume_size': 1}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2122425736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d89ad8-eb21-4da5-b347-6edf4061c22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:18Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Creating volume 17d89ad8-eb21-4da5-b347-6edf4061c22f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:17 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=125, name=volume-17d89ad8-eb21-4da5-b347-6edf4061c22f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f 1073741824" returned: 0 in 0.361s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f" returned: 0 in 0.092s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] <== create_volume: return (521ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.533s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb8a0e0-32b5-4001-87ec-63101f1ff27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d89ad8-eb21-4da5-b347-6edf4061c22f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9607be8-524b-4d51-8531-086fed4d703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:18 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Volume volume-17d89ad8-eb21-4da5-b347-6edf4061c22f (17d89ad8-eb21-4da5-b347-6edf4061c22f): created successfully
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9607be8-524b-4d51-8531-086fed4d703a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (28ddf9d1-1f64-4b54-a8e0-db1e96ea0d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-b85c1603-b1b9-4822-89dd-9d4120bd0478 tempest-VolumesActionsTest-715142808 None] Created volume successfully.
Sep 17 07:59:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-17d89ad8-eb21-4da5-b347-6edf4061c22f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-17d89ad8-eb21-4da5-b347-6edf4061c22f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:20 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "cinder-quobyte-17d89ad8-eb21-4da5-b347-6edf4061c22f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-17d89ad8-eb21-4da5-b347-6edf4061c22f" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b9a50-fe5f-490c-8299-f2a6aa272c79]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f" returned: 0 in 0.399s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-17d89ad8-eb21-4da5-b347-6edf4061c22f" returned: 0 in 0.099s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-quobyte-17d89ad8-eb21-4da5-b347-6edf4061c22f" released by "delete_volume" :: held 0.646s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Created reservations ['8d735f93-c393-4eab-9fc9-f5005592ff94', '7d181df4-c2d3-4f24-b78c-1d6af9dc93d2', 'bfe58341-24ff-4ea9-ba6b-929cab5d78e4', '7b49a6d6-aa00-48d5-94c9-b06f2fae589b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Deleted volume successfully.
Sep 17 07:59:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-fbb974ab-0688-4529-8c68-e2ed04a5df23 tempest-VolumesActionsTest-1878608667 None] Lock "cinder-17d89ad8-eb21-4da5-b347-6edf4061c22f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:22 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:22 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:22 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (e1af3596-d592-46d2-917f-2b3182dea384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:22 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870b5982-6917-4c65-b813-de615056918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (870b5982-6917-4c65-b813-de615056918b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-154537274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a976edc-193d-479a-a80f-07074d0162b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:23Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b5069a-8ba2-4846-a3fa-9d0830a49882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b5069a-8ba2-4846-a3fa-9d0830a49882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97114bea-f532-4ec2-89c9-a1d721dc876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97114bea-f532-4ec2-89c9-a1d721dc876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a976edc-193d-479a-a80f-07074d0162b3', 'volume_name': 'volume-8a976edc-193d-479a-a80f-07074d0162b3', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f72248-460a-4091-ac00-47cd6085fdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16f72248-460a-4091-ac00-47cd6085fdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b0295f-1b96-4c13-851f-20a558da4c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:23 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Volume 8a976edc-193d-479a-a80f-07074d0162b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a976edc-193d-479a-a80f-07074d0162b3', 'volume_size': 1}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-154537274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a976edc-193d-479a-a80f-07074d0162b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f27c5cfaa9489c9b1584e48147a26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:23Z,use_quota=True,user_id='3c7875af5bc949e5a1702eb0f40da62f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Creating volume 8a976edc-193d-479a-a80f-07074d0162b3 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:23 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:23 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=126, name=volume-8a976edc-193d-479a-a80f-07074d0162b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3 1073741824" returned: 0 in 0.329s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] <== create_volume: return (514ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.528s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b0295f-1b96-4c13-851f-20a558da4c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a976edc-193d-479a-a80f-07074d0162b3', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4bba9a-f7d1-45df-b834-92590aa8e5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:24 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Volume volume-8a976edc-193d-479a-a80f-07074d0162b3 (8a976edc-193d-479a-a80f-07074d0162b3): created successfully
Sep 17 07:59:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4bba9a-f7d1-45df-b834-92590aa8e5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Flow 'volume_create_manager' (e1af3596-d592-46d2-917f-2b3182dea384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:24 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-af564135-2f76-410d-89bc-464746bb58c5 tempest-VolumesActionsTest-715142808 None] Created volume successfully.
Sep 17 07:59:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Acquiring lock "cinder-8a976edc-193d-479a-a80f-07074d0162b3-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Lock "cinder-8a976edc-193d-479a-a80f-07074d0162b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Acquiring lock "cinder-quobyte-8a976edc-193d-479a-a80f-07074d0162b3" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Lock "cinder-quobyte-8a976edc-193d-479a-a80f-07074d0162b3" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bab134f-7da3-41fb-ae3b-ba96c168c26a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3" returned: 0 in 0.444s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8a976edc-193d-479a-a80f-07074d0162b3" returned: 0 in 0.109s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Lock "cinder-quobyte-8a976edc-193d-479a-a80f-07074d0162b3" released by "delete_volume" :: held 0.698s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Created reservations ['656c0994-b9c9-4973-b39b-6f6160b76827', '2c58b1d2-2973-4630-bf5a-32ae193458a5', 'be488861-6106-4317-bd4a-29b12223e1b5', 'd14b06b0-8b89-4e52-8607-f6b4992d53f3'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.092s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Deleted volume successfully.
Sep 17 07:59:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c6eddafb-05de-4faa-80ac-32e1ceab8e80 tempest-VolumesActionsTest-715142808 None] Lock "cinder-8a976edc-193d-479a-a80f-07074d0162b3-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:36 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=45,cinder:UPDATE=70,cinder:INSERT=9,cinder:DELETE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:59:37 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=42,cinder:UPDATE=57,cinder:DELETE=9,cinder:INSERT=17 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 07:59:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Flow 'volume_create_manager' (8ee32dc4-0083-4f8a-8013-e0a65cc70ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcce721c-2cb7-49d9-bd3d-39955214d043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcce721c-2cb7-49d9-bd3d-39955214d043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1325771995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc98ea-9be1-4e5d-b0b9-448a2f69d196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a492bab2df334bce892b7e1304fc881f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:42Z,use_quota=True,user_id='f081823b52604753a570e51d07be3c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c62c9-4864-48c5-92c9-888bc0906ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c62c9-4864-48c5-92c9-888bc0906ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9126c60-41f4-4054-807b-67919ffe90c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9126c60-41f4-4054-807b-67919ffe90c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cc98ea-9be1-4e5d-b0b9-448a2f69d196', 'volume_name': 'volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdc27e3-fa98-480a-ba64-d8396965f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdc27e3-fa98-480a-ba64-d8396965f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e8491a-85aa-45fe-8779-d27ba23fb09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:41 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Volume 62cc98ea-9be1-4e5d-b0b9-448a2f69d196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196', 'volume_size': 1}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1325771995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc98ea-9be1-4e5d-b0b9-448a2f69d196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a492bab2df334bce892b7e1304fc881f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:42Z,use_quota=True,user_id='f081823b52604753a570e51d07be3c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Creating volume 62cc98ea-9be1-4e5d-b0b9-448a2f69d196 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:41 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:42 devstack quobyte-client[83654]: System call of process 97474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:59:42 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=127, name=volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196 1073741824" returned: 0 in 0.345s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] <== create_volume: return (494ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.505s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6e8491a-85aa-45fe-8779-d27ba23fb09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49903460-4fc5-4e98-ba62-078bf0876a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:42 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Volume volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196 (62cc98ea-9be1-4e5d-b0b9-448a2f69d196): created successfully
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49903460-4fc5-4e98-ba62-078bf0876a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Flow 'volume_create_manager' (8ee32dc4-0083-4f8a-8013-e0a65cc70ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:42 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a83b696e-2e62-4afa-8de0-9c83bf4fc2c4 tempest-VolumesListAdminTestJSON-394723741 None] Created volume successfully.
Sep 17 07:59:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Flow 'volume_create_manager' (8d2db3a7-79cf-4240-a3cf-28559050eaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9d85ae-8b37-442b-a280-0d4baae546da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9d85ae-8b37-442b-a280-0d4baae546da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1206461221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2b4372-4065-4154-b63d-60ca7d758504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a492bab2df334bce892b7e1304fc881f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:44Z,use_quota=True,user_id='f081823b52604753a570e51d07be3c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468dfd26-c7be-4cd4-8678-718bfe18a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468dfd26-c7be-4cd4-8678-718bfe18a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79b26a1-d9c3-45e9-b02d-c75dd04ed50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79b26a1-d9c3-45e9-b02d-c75dd04ed50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d2b4372-4065-4154-b63d-60ca7d758504', 'volume_name': 'volume-5d2b4372-4065-4154-b63d-60ca7d758504', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7076315-80a9-4a95-953c-c4e7b9bfb08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7076315-80a9-4a95-953c-c4e7b9bfb08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc8b61d-b68d-4ee7-8354-332fa52e98e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:44 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Volume 5d2b4372-4065-4154-b63d-60ca7d758504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d2b4372-4065-4154-b63d-60ca7d758504', 'volume_size': 1}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1206461221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d2b4372-4065-4154-b63d-60ca7d758504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a492bab2df334bce892b7e1304fc881f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:44Z,use_quota=True,user_id='f081823b52604753a570e51d07be3c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Creating volume 5d2b4372-4065-4154-b63d-60ca7d758504 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:44 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:44 devstack quobyte-client[83654]: System call of process 97480 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:59:44 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=128, name=volume-5d2b4372-4065-4154-b63d-60ca7d758504, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504 1073741824" returned: 0 in 0.344s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504" returned: 0 in 0.089s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] <== create_volume: return (499ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.511s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc8b61d-b68d-4ee7-8354-332fa52e98e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d2b4372-4065-4154-b63d-60ca7d758504', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fd81ef-c681-4395-83c8-2a0daf939b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:45 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Volume volume-5d2b4372-4065-4154-b63d-60ca7d758504 (5d2b4372-4065-4154-b63d-60ca7d758504): created successfully
Sep 17 07:59:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fd81ef-c681-4395-83c8-2a0daf939b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:45 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Flow 'volume_create_manager' (8d2db3a7-79cf-4240-a3cf-28559050eaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:45 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6b8fccc7-96c7-41cb-ac36-1fd78be6d41c tempest-VolumesListAdminTestJSON-394723741 None] Created volume successfully.
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.159s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Flow 'volume_create_manager' (94510966-ad18-490b-abba-53a234a051e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5214e3-649b-4b57-8207-3be0157480e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5214e3-649b-4b57-8207-3be0157480e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-148509397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1711f4af-a096-433c-b95d-d8952b7ee2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a492bab2df334bce892b7e1304fc881f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:47Z,use_quota=True,user_id='f081823b52604753a570e51d07be3c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b548550-1cba-404c-be63-bc28c9c53efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b548550-1cba-404c-be63-bc28c9c53efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cd05b1-d64c-4053-8d61-5245217116a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5cd05b1-d64c-4053-8d61-5245217116a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1711f4af-a096-433c-b95d-d8952b7ee2cc', 'volume_name': 'volume-1711f4af-a096-433c-b95d-d8952b7ee2cc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ecd394-9256-4ae7-a8a0-08d6442d62ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ecd394-9256-4ae7-a8a0-08d6442d62ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5982a39d-16c0-4ec2-92bf-9cd9a8dfbc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:47 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Volume 1711f4af-a096-433c-b95d-d8952b7ee2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1711f4af-a096-433c-b95d-d8952b7ee2cc', 'volume_size': 1}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-148509397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1711f4af-a096-433c-b95d-d8952b7ee2cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a492bab2df334bce892b7e1304fc881f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:47Z,use_quota=True,user_id='f081823b52604753a570e51d07be3c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Creating volume 1711f4af-a096-433c-b95d-d8952b7ee2cc {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:47 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:47 devstack quobyte-client[83654]: System call of process 97485 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:59:47 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=129, name=volume-1711f4af-a096-433c-b95d-d8952b7ee2cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc 1073741824" returned: 0 in 0.324s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc" returned: 0 in 0.087s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] <== create_volume: return (476ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5982a39d-16c0-4ec2-92bf-9cd9a8dfbc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1711f4af-a096-433c-b95d-d8952b7ee2cc', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae4d046-768a-4b93-bc0b-9bdcf38cda23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:48 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Volume volume-1711f4af-a096-433c-b95d-d8952b7ee2cc (1711f4af-a096-433c-b95d-d8952b7ee2cc): created successfully
Sep 17 07:59:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae4d046-768a-4b93-bc0b-9bdcf38cda23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Flow 'volume_create_manager' (94510966-ad18-490b-abba-53a234a051e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:48 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-750ee653-5edf-4126-b60b-cd291a808480 tempest-VolumesListAdminTestJSON-394723741 None] Created volume successfully.
Sep 17 07:59:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:49 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Flow 'volume_create_manager' (38f27fb2-14fc-49a9-aecf-b43b69235833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e14c66f-d1ce-45fc-864d-a9fe12ca9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e14c66f-d1ce-45fc-864d-a9fe12ca9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22be080-149e-473c-b8dc-ec0840beaca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823570ae107943c6aea4f68d68eb1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:50Z,use_quota=True,user_id='8328ea134dab4365bb1ae39894c89b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5943a6dd-33ad-41b1-a09b-b3327d886c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5943a6dd-33ad-41b1-a09b-b3327d886c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d597b7-f3c0-4a70-9251-7cd41b9bb211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d597b7-f3c0-4a70-9251-7cd41b9bb211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22be080-149e-473c-b8dc-ec0840beaca7', 'volume_name': 'volume-a22be080-149e-473c-b8dc-ec0840beaca7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52419fa5-caa4-4c03-9fc6-d1dd23a2bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52419fa5-caa4-4c03-9fc6-d1dd23a2bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc77682-404a-456f-8c6c-ac8a9142bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:50 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Volume a22be080-149e-473c-b8dc-ec0840beaca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22be080-149e-473c-b8dc-ec0840beaca7', 'volume_size': 1}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T05:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22be080-149e-473c-b8dc-ec0840beaca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823570ae107943c6aea4f68d68eb1c6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:59:50Z,use_quota=True,user_id='8328ea134dab4365bb1ae39894c89b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Creating volume a22be080-149e-473c-b8dc-ec0840beaca7 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 07:59:50 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:50 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=130, name=volume-a22be080-149e-473c-b8dc-ec0840beaca7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7 1073741824" returned: 0 in 0.452s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7" returned: 0 in 0.175s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 07:59:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc77682-404a-456f-8c6c-ac8a9142bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22be080-149e-473c-b8dc-ec0840beaca7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f328272-00b6-4d08-964f-894d7dc3f1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 07:59:51 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Volume volume-a22be080-149e-473c-b8dc-ec0840beaca7 (a22be080-149e-473c-b8dc-ec0840beaca7): created successfully
Sep 17 07:59:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f328272-00b6-4d08-964f-894d7dc3f1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 07:59:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Flow 'volume_create_manager' (38f27fb2-14fc-49a9-aecf-b43b69235833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 07:59:51 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9706c841-f7cf-40c5-b02b-da1e642a6c04 tempest-VolumesListAdminTestJSON-2104684852 None] Created volume successfully.
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Acquiring lock "cinder-a22be080-149e-473c-b8dc-ec0840beaca7-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Lock "cinder-a22be080-149e-473c-b8dc-ec0840beaca7-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:52 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Acquiring lock "cinder-quobyte-a22be080-149e-473c-b8dc-ec0840beaca7" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "cinder-1711f4af-a096-433c-b95d-d8952b7ee2cc-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Lock "cinder-quobyte-a22be080-149e-473c-b8dc-ec0840beaca7" acquired by "delete_volume" :: waited 0.051s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-1711f4af-a096-433c-b95d-d8952b7ee2cc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4bb085-4c69-4d31-8bbe-c2432fb269ba]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "cinder-quobyte-1711f4af-a096-433c-b95d-d8952b7ee2cc" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-quobyte-1711f4af-a096-433c-b95d-d8952b7ee2cc" acquired by "delete_volume" :: waited 0.071s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e357e977-a560-49d9-bc37-5fb0351e42ce]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:53 devstack quobyte-client[83654]: System call of process 97494 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7" returned: 0 in 0.867s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a22be080-149e-473c-b8dc-ec0840beaca7" returned: 0 in 0.168s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Lock "cinder-quobyte-a22be080-149e-473c-b8dc-ec0840beaca7" released by "delete_volume" :: held 1.283s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc" returned: 0 in 0.759s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1711f4af-a096-433c-b95d-d8952b7ee2cc" returned: 0 in 0.304s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-quobyte-1711f4af-a096-433c-b95d-d8952b7ee2cc" released by "delete_volume" :: held 1.178s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Created reservations ['c64e2241-1d5d-4e17-9322-12bc7647a94f', '49383430-7355-4e57-95d3-15621edce505', '5dc162d8-e32a-48f0-b12b-a135894ecf02', 'fa22211d-0469-4bd4-9a25-9802408a0985'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Created reservations ['1380130b-e4a3-43e0-8ed7-191a86709fde', 'a8321844-6e65-44cc-bb91-a69cfcf5e841', 'a044b376-7e69-4048-b3fb-222db7527129', 'fe506ec3-fa4d-4b14-8b5b-67521938ca17'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.220s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "cinder-5d2b4372-4065-4154-b63d-60ca7d758504-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Deleted volume successfully.
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-5d2b4372-4065-4154-b63d-60ca7d758504-delete_volume" acquired by "delete_volume" :: waited 0.280s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-55158700-392f-4b7c-bc09-dafa7b40e69a tempest-VolumesListAdminTestJSON-2104684852 None] Lock "cinder-a22be080-149e-473c-b8dc-ec0840beaca7-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.336s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:55 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Deleted volume successfully.
Sep 17 07:59:55 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "cinder-quobyte-5d2b4372-4065-4154-b63d-60ca7d758504" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52f4ffb8-362e-4f98-bdd1-18b38536861a tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-1711f4af-a096-433c-b95d-d8952b7ee2cc-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:55 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-quobyte-5d2b4372-4065-4154-b63d-60ca7d758504" acquired by "delete_volume" :: waited 0.024s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5d21f-5cbc-43f9-8cbf-1daca0f7b525]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504" returned: 0 in 0.423s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-5d2b4372-4065-4154-b63d-60ca7d758504" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-quobyte-5d2b4372-4065-4154-b63d-60ca7d758504" released by "delete_volume" :: held 0.666s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:56 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Created reservations ['87bf21b4-2bcd-4be7-a7f3-be14f45c8684', 'b7b9274b-59fd-4161-9e07-dc9481b33fd2', '53b8176b-ad7d-4a3f-921f-228eb3c0f86d', '875c742d-5aac-4e15-bc73-b1fc14daf343'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:57 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Deleted volume successfully.
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-7aefb3e7-281d-4e26-82f8-1ff4539100bf tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-5d2b4372-4065-4154-b63d-60ca7d758504-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "cinder-62cc98ea-9be1-4e5d-b0b9-448a2f69d196-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-62cc98ea-9be1-4e5d-b0b9-448a2f69d196-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:57 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "cinder-quobyte-62cc98ea-9be1-4e5d-b0b9-448a2f69d196" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-quobyte-62cc98ea-9be1-4e5d-b0b9-448a2f69d196" acquired by "delete_volume" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8620ab-c2c7-428f-b02c-090b21be8060]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 07:59:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196" returned: 0 in 0.427s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-62cc98ea-9be1-4e5d-b0b9-448a2f69d196" returned: 0 in 0.100s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-quobyte-62cc98ea-9be1-4e5d-b0b9-448a2f69d196" released by "delete_volume" :: held 0.677s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Created reservations ['3b453491-52b9-4d3e-9492-bb11e6e45b96', '799958e3-0075-42e8-8a7a-023ef7a78309', 'b32d02a3-bc64-455b-8bcc-09424aa7b5c6', '9054de39-ada3-45f3-8831-941fabe2b6a2'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 07:59:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 07:59:59 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.110s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 07:59:59 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 07:59:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Deleted volume successfully.
Sep 17 07:59:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a8904f8c-e397-4991-b938-f02214b1f1af tempest-VolumesListAdminTestJSON-394723741 None] Lock "cinder-62cc98ea-9be1-4e5d-b0b9-448a2f69d196-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:00:07 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:00:07 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:00:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Flow 'volume_create_manager' (49fb9f22-62c8-44c5-a22c-3924f25e899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:00:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29489555-7f6d-49d8-b809-3e7f207e131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29489555-7f6d-49d8-b809-3e7f207e131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1326097809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4a3049-8456-422c-936e-95da23fdc662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1f93cc5651439a94091d87663cd893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:00:08Z,use_quota=True,user_id='f3a29e0df28a42a499da4aee72ec6cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e70743-1b63-4746-8c12-770303b76fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e70743-1b63-4746-8c12-770303b76fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7953f7-aa72-4dcf-9457-11061ba54d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7953f7-aa72-4dcf-9457-11061ba54d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b4a3049-8456-422c-936e-95da23fdc662', 'volume_name': 'volume-0b4a3049-8456-422c-936e-95da23fdc662', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c861e3d90>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d392ef02-ba61-41fa-aa6d-0103a555060e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d392ef02-ba61-41fa-aa6d-0103a555060e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6857d177-a5dd-400a-93ef-d4bba4b196dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:08 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Volume 0b4a3049-8456-422c-936e-95da23fdc662: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b4a3049-8456-422c-936e-95da23fdc662', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c861e3d90>}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Cloning 0b4a3049-8456-422c-936e-95da23fdc662 from image f78f338c-82d6-4001-a9f8-06473b1187dc  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 08:00:08 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Image download 20.69 MB at 20.69 MB/s
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ab24c1-9d40-462d-83f2-9933c88468a8]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:09 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD
Sep 17 08:00:09 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:00:10 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Sep 17 08:00:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD" returned: 0 in 2.064s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:10 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc is fetched for user f3a29e0df28a42a499da4aee72ec6cf2. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 08:00:11 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63da919-891d-41fd-8497-872480097c8b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:11 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD
Sep 17 08:00:11 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:00:13 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD" returned: 0 in 2.093s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1326097809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4a3049-8456-422c-936e-95da23fdc662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1f93cc5651439a94091d87663cd893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:00:08Z,use_quota=True,user_id='f3a29e0df28a42a499da4aee72ec6cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Creating volume 0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:00:13 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:13 devstack quobyte-client[83654]: System call of process 97557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:00:13 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=131, name=volume-0b4a3049-8456-422c-936e-95da23fdc662, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 1073741824" returned: 0 in 0.411s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 0 in 0.112s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] <== create_volume: return (635ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Attempting download of f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 0b4a3049-8456-422c-936e-95da23fdc662. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e2ea7-4e81-40aa-9f4a-5c7d4e2ffcfa]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_proaydn0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_proaydn0" returned: 0 in 0.331s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_proaydn0 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_proaydn0" returned: 1 in 0.349s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f78f338c-82d6-4001-a9f8-06473b1187dc_proaydn0' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[df70fcfc-303c-4a67-8e88-4e04d4d46c3a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] f78f338c-82d6-4001-a9f8-06473b1187dc was qcow2, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 08:00:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:15 devstack quobyte-client[83654]: System call of process 97572 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:00:15 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=131, name=volume-0b4a3049-8456-422c-936e-95da23fdc662, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:00:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 0 in 1.094s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:16 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f78f338c-82d6-4001-a9f8-06473b1187dc_qsed_gkcdevstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:00:16 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Converted 112.00 MB image at 99.93 MB/s
Sep 17 08:00:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 1G" returned: 0 in 0.134s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:16 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c563c369-2304-45e5-8054-8d2a6d60ad2c]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 0 in 0.366s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 1 in 0.371s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Downloaded image f78f338c-82d6-4001-a9f8-06473b1187dc ((None, None)) to volume 0b4a3049-8456-422c-936e-95da23fdc662 successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Temporary image f78f338c-82d6-4001-a9f8-06473b1187dc for user f3a29e0df28a42a499da4aee72ec6cf2 is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Marking volume 0b4a3049-8456-422c-936e-95da23fdc662 as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Copying metadata from image f78f338c-82d6-4001-a9f8-06473b1187dc to 0b4a3049-8456-422c-936e-95da23fdc662. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 08:00:17 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Creating volume glance metadata for volume 0b4a3049-8456-422c-936e-95da23fdc662 backed by image f78f338c-82d6-4001-a9f8-06473b1187dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 08:00:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6857d177-a5dd-400a-93ef-d4bba4b196dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4a3049-8456-422c-936e-95da23fdc662', 'volume_size': 1, 'image_id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55cbc4abe998468c90b25185ef6b2421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f78f338c-82d6-4001-a9f8-06473b1187dc', 'created_at': datetime.datetime(2025, 9, 17, 5, 17, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 17, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f78f338c-82d6-4001-a9f8-06473b1187dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c861e3d90>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021f1308-6e2b-4be8-b367-df816bef6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:18 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Volume volume-0b4a3049-8456-422c-936e-95da23fdc662 (0b4a3049-8456-422c-936e-95da23fdc662): created successfully
Sep 17 08:00:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021f1308-6e2b-4be8-b367-df816bef6316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Flow 'volume_create_manager' (49fb9f22-62c8-44c5-a22c-3924f25e899f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:00:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-041d5abe-9ae7-4a45-824a-d1cfd6441c9e tempest-VolumesImageMetadata-1953088595 None] Created volume successfully.
Sep 17 08:00:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Acquiring lock "cinder-0b4a3049-8456-422c-936e-95da23fdc662-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:00:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Lock "cinder-0b4a3049-8456-422c-936e-95da23fdc662-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:00:19 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:00:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Acquiring lock "cinder-quobyte-0b4a3049-8456-422c-936e-95da23fdc662" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:00:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Lock "cinder-quobyte-0b4a3049-8456-422c-936e-95da23fdc662" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcad7f4-97f4-44ca-a2f9-72b720a6693d]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 0 in 0.375s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 1 in 0.364s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0b4a3049-8456-422c-936e-95da23fdc662" returned: 0 in 0.098s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Lock "cinder-quobyte-0b4a3049-8456-422c-936e-95da23fdc662" released by "delete_volume" :: held 1.055s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Created reservations ['d1cbfc97-db26-4a03-861f-0bd375b784ea', '1b687523-9f92-44a1-8e5c-1f189f976a68', '340516c7-6efa-4df0-b7ca-f87f84cd8626', '375d6686-9cb1-4c1f-a77f-c5f442fcb942'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.091s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:00:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Deleted volume successfully.
Sep 17 08:00:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-a3669764-2224-41db-b309-da4ea90ef53d tempest-VolumesImageMetadata-1953088595 None] Lock "cinder-0b4a3049-8456-422c-936e-95da23fdc662-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:00:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Flow 'volume_create_manager' (426aad57-61bb-4d4a-a1ed-cacdff06a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8288e8a-1c99-446f-9458-d1c4944e72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8288e8a-1c99-446f-9458-d1c4944e72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1762455896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe937cdd-6582-4a6b-a623-eaf5d722ef70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ac1648d53e4b7baac49128b784af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:00:26Z,use_quota=True,user_id='b8a8e9363b534175a877c0a5ccb3b2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559c6564-2df9-44a6-899a-b62f5b179dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559c6564-2df9-44a6-899a-b62f5b179dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6734c61e-5e10-48ce-86c0-62d52dbd5c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6734c61e-5e10-48ce-86c0-62d52dbd5c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe937cdd-6582-4a6b-a623-eaf5d722ef70', 'volume_name': 'volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da46600a-d487-484c-b899-97dfd73bb5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da46600a-d487-484c-b899-97dfd73bb5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff50956-d8c9-44e3-a9da-049799a64c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:25 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Volume fe937cdd-6582-4a6b-a623-eaf5d722ef70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70', 'volume_size': 1}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1762455896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe937cdd-6582-4a6b-a623-eaf5d722ef70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ac1648d53e4b7baac49128b784af1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:00:26Z,use_quota=True,user_id='b8a8e9363b534175a877c0a5ccb3b2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Creating volume fe937cdd-6582-4a6b-a623-eaf5d722ef70 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:00:25 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:00:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:26 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=132, name=volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70 1073741824" returned: 0 in 0.341s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70" returned: 0 in 0.086s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff50956-d8c9-44e3-a9da-049799a64c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646413b9-4e88-4507-b444-3d4a2eebaaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:26 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Volume volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70 (fe937cdd-6582-4a6b-a623-eaf5d722ef70): created successfully
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646413b9-4e88-4507-b444-3d4a2eebaaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Flow 'volume_create_manager' (426aad57-61bb-4d4a-a1ed-cacdff06a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:00:26 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-314ab0f5-e7cc-4cc9-b006-4e78af714b94 tempest-AbsoluteLimitsTests-278170985 None] Created volume successfully.
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Acquiring lock "cinder-fe937cdd-6582-4a6b-a623-eaf5d722ef70-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Lock "cinder-fe937cdd-6582-4a6b-a623-eaf5d722ef70-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:00:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Acquiring lock "cinder-quobyte-fe937cdd-6582-4a6b-a623-eaf5d722ef70" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Lock "cinder-quobyte-fe937cdd-6582-4a6b-a623-eaf5d722ef70" acquired by "delete_volume" :: waited 0.020s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf27855-f0fd-4c4b-81d6-0047f047b471]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70" returned: 0 in 0.411s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fe937cdd-6582-4a6b-a623-eaf5d722ef70" returned: 0 in 0.107s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Lock "cinder-quobyte-fe937cdd-6582-4a6b-a623-eaf5d722ef70" released by "delete_volume" :: held 0.673s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Created reservations ['979309b9-1bdc-4b32-bb60-6f4c6a4d0494', 'd97e76a5-4bc6-40c5-8cb6-f4018fc4187f', 'e47bbb58-0a9e-47e2-8e21-86b4883e4319', 'c57f06b6-c01c-432b-ac94-5c9e9e0549d9'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:00:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Deleted volume successfully.
Sep 17 08:00:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5e4791f1-5f6a-40e8-a747-4b89dc210503 tempest-AbsoluteLimitsTests-278170985 None] Lock "cinder-fe937cdd-6582-4a6b-a623-eaf5d722ef70-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:00:39 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=47,cinder:UPDATE=72,cinder:DELETE=6,cinder:INSERT=19 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:00:39 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=52,cinder:SELECT=41,cinder:DELETE=6,cinder:INSERT=18 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.134s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:00:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Flow 'volume_create_manager' (f90279af-099c-43ed-940d-b69030256a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b11ce-706a-44c9-9fbe-a964b161955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877b11ce-706a-44c9-9fbe-a964b161955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-940161660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed32fe34-0e5f-4310-85ad-3af363267ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4692dd56c4f4820b1ff98b5bead5709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:00:49Z,use_quota=True,user_id='3300bf14bdfd4a94bbb3f664b53e3cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb3346-2050-419b-b2d8-552e29345c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fb3346-2050-419b-b2d8-552e29345c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8216af03-7db8-4c29-aead-2c1b49a13ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8216af03-7db8-4c29-aead-2c1b49a13ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed32fe34-0e5f-4310-85ad-3af363267ef6', 'volume_name': 'volume-ed32fe34-0e5f-4310-85ad-3af363267ef6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a53073-3ab7-4507-9a06-bd6c50ffa7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a53073-3ab7-4507-9a06-bd6c50ffa7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8c5509-5bcd-4dd7-9a92-4d61e08cfe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:49 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Volume ed32fe34-0e5f-4310-85ad-3af363267ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed32fe34-0e5f-4310-85ad-3af363267ef6', 'volume_size': 1}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-940161660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed32fe34-0e5f-4310-85ad-3af363267ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4692dd56c4f4820b1ff98b5bead5709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:00:49Z,use_quota=True,user_id='3300bf14bdfd4a94bbb3f664b53e3cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Creating volume ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:00:49 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:49 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=133, name=volume-ed32fe34-0e5f-4310-85ad-3af363267ef6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 1073741824" returned: 0 in 0.334s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.091s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:00:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.509s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:00:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8c5509-5bcd-4dd7-9a92-4d61e08cfe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed32fe34-0e5f-4310-85ad-3af363267ef6', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0737cd-6eb4-4d8a-9025-dc5f3f3b92bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:00:50 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Volume volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 (ed32fe34-0e5f-4310-85ad-3af363267ef6): created successfully
Sep 17 08:00:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0737cd-6eb4-4d8a-9025-dc5f3f3b92bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:00:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Flow 'volume_create_manager' (f90279af-099c-43ed-940d-b69030256a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:00:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-dc26f84d-ee17-49d5-b829-d365c45b7fce tempest-VolumesActionsTest-463193826 None] Created volume successfully.
Sep 17 08:01:00 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:01:00 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:01:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db2c79ff-a478-43aa-9916-009bf1e38076 tempest-VolumesActionsTest-463193826 None] Acquiring lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6" by "attach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:01:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db2c79ff-a478-43aa-9916-009bf1e38076 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6" acquired by "attach_volume" :: waited 0.032s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:01:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-db2c79ff-a478-43aa-9916-009bf1e38076 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:01:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-db2c79ff-a478-43aa-9916-009bf1e38076 tempest-VolumesActionsTest-463193826 None] Attaching volume ed32fe34-0e5f-4310-85ad-3af363267ef6 to instance 0e58d23b-0b86-4c47-8d68-66d4dfbe67dd at mountpoint /dev/vdb on host None.
Sep 17 08:01:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-db2c79ff-a478-43aa-9916-009bf1e38076 tempest-VolumesActionsTest-463193826 None] Attach volume completed successfully.
Sep 17 08:01:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db2c79ff-a478-43aa-9916-009bf1e38076 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6" released by "attach_volume" :: held 0.303s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:01:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Acquiring lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-detach_volume" by "detach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:01:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:01:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:01:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Detaching volume ed32fe34-0e5f-4310-85ad-3af363267ef6 from instance 0e58d23b-0b86-4c47-8d68-66d4dfbe67dd.
Sep 17 08:01:18 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:01:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Detach volume completed successfully.
Sep 17 08:01:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-eaea1447-1c8d-4510-b929-534357d4f7ca tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:01:28 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:01:28 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.098s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:01:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:01:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b0027d5-bb22-40fd-8d76-dc3d129995b1 tempest-VolumesActionsTest-463193826 None] Acquiring lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6" by "attach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:01:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b0027d5-bb22-40fd-8d76-dc3d129995b1 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6" acquired by "attach_volume" :: waited 0.094s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:01:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0b0027d5-bb22-40fd-8d76-dc3d129995b1 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:01:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0b0027d5-bb22-40fd-8d76-dc3d129995b1 tempest-VolumesActionsTest-463193826 None] Attaching volume ed32fe34-0e5f-4310-85ad-3af363267ef6 to instance ae261c20-9e80-40b5-9a11-899aa0066875 at mountpoint /dev/vdb on host None.
Sep 17 08:01:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0b0027d5-bb22-40fd-8d76-dc3d129995b1 tempest-VolumesActionsTest-463193826 None] Attach volume completed successfully.
Sep 17 08:01:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0b0027d5-bb22-40fd-8d76-dc3d129995b1 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6" released by "attach_volume" :: held 0.322s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:01:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Acquiring lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-detach_volume" by "detach_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:01:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:01:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:01:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Detaching volume ed32fe34-0e5f-4310-85ad-3af363267ef6 from instance ae261c20-9e80-40b5-9a11-899aa0066875.
Sep 17 08:01:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:01:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Detach volume completed successfully.
Sep 17 08:01:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-80c6e88f-9cd2-4153-bf4b-3af2d8fe6db9 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:01:59 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:INSERT=1,cinder:SELECT=9,cinder:UPDATE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:01:59 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:02:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf09ae7a-67b4-4213-9d60-3bbe6d227d12]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.414s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fca2bc-04b6-458b-80a7-b817b5bfb9bb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.391s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.3c6e92bc-7ced-4e3e-995b-464ea946af0fv56pv3jh.img {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.3c6e92bc-7ced-4e3e-995b-464ea946af0fv56pv3jh.img" returned: 0 in 6.220s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:07 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0e923-7c1f-4c29-9aa7-2680688f4aa1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.585s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:08 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Image conversion details: src /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.3c6e92bc-7ced-4e3e-995b-464ea946af0fv56pv3jh.img {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:02:08 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Converted 1024.00 MB image at 164.03 MB/s
Sep 17 08:02:08 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] 3c6e92bc-7ced-4e3e-995b-464ea946af0f was raw, no need to convert to raw {{(pid=83645) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 17 08:02:18 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:02:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.660s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:02:39 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Uploaded volume to glance image-id: 3c6e92bc-7ced-4e3e-995b-464ea946af0f. {{(pid=83645) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 17 08:02:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c827e7a1-4a8f-42f4-8aea-c56b4025be39 tempest-VolumesActionsTest-463193826 None] Copy volume to image completed successfully.
Sep 17 08:02:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60053ff-8717-4baf-b4ea-ac153a031530]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.404s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ef4c55-12aa-465a-adf4-c42111341ba1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.414s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img" returned: 0 in 5.219s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2b891-8934-410b-8d9d-620208cff7f8]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.108s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.582s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Image conversion details: src /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:02:47 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Converted 1024.00 MB image at 195.21 MB/s
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] 9dafdd7d-50ff-422f-a910-7a8a4f594302 was raw, converting to qcow2 {{(pid=83645) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d06e18-56c3-4667-99d2-29f3e7852d19]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img" returned: 0 in 0.338s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img" returned: 1 in 0.361s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:02:47 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img /opt/stack/data/cinder/conversion/vol_upload_ufwvp50d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img /opt/stack/data/cinder/conversion/vol_upload_ufwvp50d" returned: 0 in 0.164s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:48 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Image conversion details: src /opt/stack/data/cinder/conversion/ed32fe34-0e5f-4310-85ad-3af363267ef6.temp_image.9dafdd7d-50ff-422f-a910-7a8a4f59430205ykjsoe.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ufwvp50d {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:02:48 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 17 08:02:48 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c4d2b5-7e6a-4d93-89aa-8a6ae85aeb38]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ufwvp50d {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ufwvp50d" returned: 0 in 0.350s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.573s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:02:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Uploaded volume to glance image-id: 9dafdd7d-50ff-422f-a910-7a8a4f594302. {{(pid=83645) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 17 08:02:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-fc5842ae-e7b5-4943-a1e8-0216edc1c3f3 tempest-VolumesActionsTest-463193826 None] Copy volume to image completed successfully.
Sep 17 08:02:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Acquiring lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:02:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:02:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:02:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Acquiring lock "cinder-quobyte-ed32fe34-0e5f-4310-85ad-3af363267ef6" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:02:51 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Lock "cinder-quobyte-ed32fe34-0e5f-4310-85ad-3af363267ef6" acquired by "delete_volume" :: waited 0.015s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:02:51 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a910a-9087-4702-a416-0704f736770d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:02:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.393s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-ed32fe34-0e5f-4310-85ad-3af363267ef6" returned: 0 in 0.100s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Lock "cinder-quobyte-ed32fe34-0e5f-4310-85ad-3af363267ef6" released by "delete_volume" :: held 0.637s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Created reservations ['02c1f623-d9ed-49cc-8a2c-f2c95fe02641', '1f4251a3-752f-45ac-b389-6979a7292fe9', '32c33cda-2330-415a-a044-a8c70cb62613', '2bade5d1-cc05-46b8-afc4-9a1bba6d250b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:02:52 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:02:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:02:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:02:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:02:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:02:53 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:02:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Deleted volume successfully.
Sep 17 08:02:53 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e53bc5a7-b325-4c17-9af8-f4864bf9f972 tempest-VolumesActionsTest-463193826 None] Lock "cinder-ed32fe34-0e5f-4310-85ad-3af363267ef6-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:03:02 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:03:03 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=9,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:03:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Flow 'volume_create_manager' (7707c7bd-ac01-40fd-886a-f6d9d022bdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67884b66-22ca-43f5-bcc3-2fc5dea27163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67884b66-22ca-43f5-bcc3-2fc5dea27163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-983693358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ce2d30-20e1-4d88-9319-e791bf3fa797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76808a40046413bbeb4ee3d19dab65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:03:27Z,use_quota=True,user_id='ac73cb08590b43feb1231f4025115f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86e6f2c9-3433-4217-bce9-090dc42c575b),volume_type_id=86e6f2c9-3433-4217-bce9-090dc42c575b)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95af994-75eb-4564-8533-97130ff57d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95af994-75eb-4564-8533-97130ff57d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63d4427-f587-4baa-a550-43573bdb5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63d4427-f587-4baa-a550-43573bdb5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ce2d30-20e1-4d88-9319-e791bf3fa797', 'volume_name': 'volume-36ce2d30-20e1-4d88-9319-e791bf3fa797', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce51c5f9-a009-4ad0-ba9f-890bb54e60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce51c5f9-a009-4ad0-ba9f-890bb54e60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df51d674-f9e4-466a-9aa0-8422e373941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume 36ce2d30-20e1-4d88-9319-e791bf3fa797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ce2d30-20e1-4d88-9319-e791bf3fa797', 'volume_size': 1}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-983693358',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ce2d30-20e1-4d88-9319-e791bf3fa797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76808a40046413bbeb4ee3d19dab65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:03:27Z,use_quota=True,user_id='ac73cb08590b43feb1231f4025115f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86e6f2c9-3433-4217-bce9-090dc42c575b),volume_type_id=86e6f2c9-3433-4217-bce9-090dc42c575b)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Creating volume 36ce2d30-20e1-4d88-9319-e791bf3fa797 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:03:27 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=134, name=volume-36ce2d30-20e1-4d88-9319-e791bf3fa797, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:03:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 1073741824" returned: 0 in 0.591s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Flow 'volume_create_manager' (6fc7d6a2-ce85-4a9f-8686-a4a29190137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f268b996-86e4-4a0c-b8fa-89445e010f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797" returned: 0 in 0.592s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f268b996-86e4-4a0c-b8fa-89445e010f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071041415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76808a40046413bbeb4ee3d19dab65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:03:28Z,use_quota=True,user_id='ac73cb08590b43feb1231f4025115f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88be5f55-4b4d-467e-915c-0c7e92fb4093),volume_type_id=88be5f55-4b4d-467e-915c-0c7e92fb4093)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b08a4b-2f5e-40ae-a422-6bf9f5017e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b08a4b-2f5e-40ae-a422-6bf9f5017e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a65b04-f536-4136-b841-2f713fa3117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a65b04-f536-4136-b841-2f713fa3117b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960', 'volume_name': 'volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5473c69d-03d4-48b0-b53a-616ef24252dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5473c69d-03d4-48b0-b53a-616ef24252dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ebc3b3-a137-4cc3-b8fa-c336a51fa501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:28 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume 10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960', 'volume_size': 1}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] <== create_volume: return (1257ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071041415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76808a40046413bbeb4ee3d19dab65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:03:28Z,use_quota=True,user_id='ac73cb08590b43feb1231f4025115f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88be5f55-4b4d-467e-915c-0c7e92fb4093),volume_type_id=88be5f55-4b4d-467e-915c-0c7e92fb4093)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Creating volume 10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:03:28 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:03:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:28 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=135, name=volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df51d674-f9e4-466a-9aa0-8422e373941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ce2d30-20e1-4d88-9319-e791bf3fa797', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac4be10-4849-4ae9-9161-a7bf9954a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Flow 'volume_create_manager' (570f2262-967f-4b69-8181-be9ffec1bc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139ed96e-9313-4034-9782-bf858c4afe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139ed96e-9313-4034-9782-bf858c4afe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-656653327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14f8d03-3424-4645-8f0e-dcd1523aa717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76808a40046413bbeb4ee3d19dab65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:03:28Z,use_quota=True,user_id='ac73cb08590b43feb1231f4025115f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4285e824-6b4a-429a-a425-875244117229),volume_type_id=4285e824-6b4a-429a-a425-875244117229)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24fd3dd-e10d-4118-90e1-4de55bdc047f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24fd3dd-e10d-4118-90e1-4de55bdc047f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffbd52d-30c9-4cd9-936c-a0abbb366dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 1073741824" returned: 0 in 0.683s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 (36ce2d30-20e1-4d88-9319-e791bf3fa797): created successfully
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac4be10-4849-4ae9-9161-a7bf9954a60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Flow 'volume_create_manager' (7707c7bd-ac01-40fd-886a-f6d9d022bdc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-099a3d85-6a7d-4d35-9ad5-43d0503daec3 tempest-TestInstancesWithCinderVolumes-184934830 None] Created volume successfully.
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" returned: 0 in 0.409s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] <== create_volume: return (1160ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ebc3b3-a137-4cc3-b8fa-c336a51fa501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabb4ed5-7ea4-47cf-81c4-0cfb3e28ca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ffbd52d-30c9-4cd9-936c-a0abbb366dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e14f8d03-3424-4645-8f0e-dcd1523aa717', 'volume_name': 'volume-e14f8d03-3424-4645-8f0e-dcd1523aa717', 'volume_size': 1, 'image_id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--949793739', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e76808a40046413bbeb4ee3d19dab65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'created_at': datetime.datetime(2025, 9, 17, 6, 3, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 3, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c6af761-bbc9-4ad6-bd67-15bfda015506/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c906bff70>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e0fc18-1bdc-4d99-8a09-6cb11e235094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93e0fc18-1bdc-4d99-8a09-6cb11e235094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b2b6cd-a10b-49b4-aed6-1f2e73687877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume e14f8d03-3424-4645-8f0e-dcd1523aa717: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e14f8d03-3424-4645-8f0e-dcd1523aa717', 'volume_size': 1, 'image_id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--949793739', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e76808a40046413bbeb4ee3d19dab65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'created_at': datetime.datetime(2025, 9, 17, 6, 3, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 3, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c6af761-bbc9-4ad6-bd67-15bfda015506/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c906bff70>}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Cloning e14f8d03-3424-4645-8f0e-dcd1523aa717 from image 0c6af761-bbc9-4ad6-bd67-15bfda015506  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 08:03:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 (10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960): created successfully
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabb4ed5-7ea4-47cf-81c4-0cfb3e28ca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Flow 'volume_create_manager' (6fc7d6a2-ce85-4a9f-8686-a4a29190137e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:03:30 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8c2f6c2a-3f9b-4009-ac9d-c5cdfdd90002 tempest-TestInstancesWithCinderVolumes-184934830 None] Created volume successfully.
Sep 17 08:03:31 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD, size 20.69 MB, duration 1.31 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 08:03:31 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Image download 20.69 MB at 15.82 MB/s
Sep 17 08:03:31 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b7561-9b4e-48cb-ade8-1e57091541d4]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:03:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:31 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD
Sep 17 08:03:31 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:03:33 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Sep 17 08:03:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD" returned: 0 in 1.997s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:33 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Temporary image 0c6af761-bbc9-4ad6-bd67-15bfda015506 is fetched for user ac73cb08590b43feb1231f4025115f91. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 08:03:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[44618f25-c043-40ca-a9c8-7dec1971f430]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:03:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:34 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD
Sep 17 08:03:34 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:03:35 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD" returned: 0 in 1.993s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-656653327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14f8d03-3424-4645-8f0e-dcd1523aa717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76808a40046413bbeb4ee3d19dab65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:03:28Z,use_quota=True,user_id='ac73cb08590b43feb1231f4025115f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4285e824-6b4a-429a-a425-875244117229),volume_type_id=4285e824-6b4a-429a-a425-875244117229)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Creating volume e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:03:35 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:03:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:35 devstack quobyte-client[83654]: System call of process 98162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:03:35 devstack quobyte-client[83654]: System call of process 98162 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:03:35 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=136, name=volume-e14f8d03-3424-4645-8f0e-dcd1523aa717, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 1073741824" returned: 0 in 0.340s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 0 in 0.092s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] <== create_volume: return (530ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Attempting download of 0c6af761-bbc9-4ad6-bd67-15bfda015506 ((None, None)) to volume e14f8d03-3424-4645-8f0e-dcd1523aa717. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f3863-1d0d-4b9a-a643-0ce7e9b967b8]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:03:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c6af761-bbc9-4ad6-bd67-15bfda015506_xrlo3pub {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c6af761-bbc9-4ad6-bd67-15bfda015506_xrlo3pub" returned: 0 in 0.360s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c6af761-bbc9-4ad6-bd67-15bfda015506_xrlo3pub {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c6af761-bbc9-4ad6-bd67-15bfda015506_xrlo3pub" returned: 1 in 0.341s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c6af761-bbc9-4ad6-bd67-15bfda015506_xrlo3pub' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf92358-28d5-478d-b154-558292b4c985]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] 0c6af761-bbc9-4ad6-bd67-15bfda015506 was qcow2, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 08:03:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:37 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=136, name=volume-e14f8d03-3424-4645-8f0e-dcd1523aa717, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:03:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 0 in 0.968s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:38 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c6af761-bbc9-4ad6-bd67-15bfda015506_yutq0m3ndevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:03:38 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Converted 112.00 MB image at 112.00 MB/s
Sep 17 08:03:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:38 devstack quobyte-client[83654]: System call of process 98180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 1G" returned: 0 in 0.123s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[1821bb9d-b568-426f-9222-ec04e67fbee7]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 0 in 0.377s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 1 in 0.398s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Downloaded image 0c6af761-bbc9-4ad6-bd67-15bfda015506 ((None, None)) to volume e14f8d03-3424-4645-8f0e-dcd1523aa717 successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Temporary image 0c6af761-bbc9-4ad6-bd67-15bfda015506 for user ac73cb08590b43feb1231f4025115f91 is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 08:03:39 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Marking volume e14f8d03-3424-4645-8f0e-dcd1523aa717 as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 08:03:40 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Copying metadata from image 0c6af761-bbc9-4ad6-bd67-15bfda015506 to e14f8d03-3424-4645-8f0e-dcd1523aa717. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 08:03:40 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Creating volume glance metadata for volume e14f8d03-3424-4645-8f0e-dcd1523aa717 backed by image 0c6af761-bbc9-4ad6-bd67-15bfda015506 with: {'image_id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'image_name': 'tempest-scenario-img--949793739', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 08:03:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b2b6cd-a10b-49b4-aed6-1f2e73687877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14f8d03-3424-4645-8f0e-dcd1523aa717', 'volume_size': 1, 'image_id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--949793739', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e76808a40046413bbeb4ee3d19dab65d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c6af761-bbc9-4ad6-bd67-15bfda015506', 'created_at': datetime.datetime(2025, 9, 17, 6, 3, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 3, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c6af761-bbc9-4ad6-bd67-15bfda015506/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c906bff70>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37618cc-d605-4f00-a653-1d54fc3d91e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:03:40 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 (e14f8d03-3424-4645-8f0e-dcd1523aa717): created successfully
Sep 17 08:03:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37618cc-d605-4f00-a653-1d54fc3d91e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:03:40 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Flow 'volume_create_manager' (570f2262-967f-4b69-8181-be9ffec1bc53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:03:40 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-84448a2c-2d68-4edd-a3e1-df4e79359133 tempest-TestInstancesWithCinderVolumes-184934830 None] Created volume successfully.
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.079s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:03:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:03:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:03:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c044d997-6a23-4e34-ad63-be25f13eede1]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:03:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 0 in 0.400s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:03:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 1 in 0.365s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:03:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:03:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:03:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-e14f8d03-3424-4645-8f0e-dcd1523aa717', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3705f968-c6b7-4344-af7e-c31b026453e7', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 08:03:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:03:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-fe12f9d9-fb6b-4329-9c20-9f86b517beed req-6a048cb4-6dff-4e73-96ac-8dcc5ec4ecd1 tempest-TestInstancesWithCinderVolumes-184934830 None] attachment_update completed successfully.
Sep 17 08:04:00 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=7,cinder:SELECT=16,cinder:DELETE=2,cinder:INSERT=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:04:00 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.104s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:04:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:05:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:05:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:05:01 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c3f59b-c5cb-4ae7-bf2b-9f9f1ca79e14]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:05:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:05:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797" returned: 0 in 0.496s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:05:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.578s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:05:02 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-36ce2d30-20e1-4d88-9319-e791bf3fa797', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '567d6876-65be-417c-8afe-f4e02069bf08', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 08:05:02 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:05:02 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-9317cf5c-cadc-4705-b195-e52664ee1ac8 req-ae816005-541f-4a89-9ef8-062a74e3edcd tempest-TestInstancesWithCinderVolumes-184934830 None] attachment_update completed successfully.
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=6 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc23d042-c256-4d70-9e2c-0eec82e092d0]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" returned: 0 in 0.402s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:05:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.468s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:05:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27b8de9d-fbcb-4618-9827-32874d317a8b', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 08:05:13 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:05:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-ca214c55-2e37-4959-a724-0efab7e33ed5 req-5d93bc5c-a4c9-4565-beef-9a92ca4ee1e9 tempest-TestInstancesWithCinderVolumes-184934830 None] attachment_update completed successfully.
Sep 17 08:05:23 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:05:23 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.079s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:05:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:05:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3e02bcae-19c5-4f1f-bc6a-0826037c9fb0 req-f7406df6-53c5-4aec-9877-9d7e242332f3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:05:47 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-3e02bcae-19c5-4f1f-bc6a-0826037c9fb0 req-f7406df6-53c5-4aec-9877-9d7e242332f3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:05:47 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-3e02bcae-19c5-4f1f-bc6a-0826037c9fb0 req-f7406df6-53c5-4aec-9877-9d7e242332f3 tempest-TestInstancesWithCinderVolumes-184934830 None] Terminate volume connection completed successfully.
Sep 17 08:05:47 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-3e02bcae-19c5-4f1f-bc6a-0826037c9fb0 req-f7406df6-53c5-4aec-9877-9d7e242332f3 tempest-TestInstancesWithCinderVolumes-184934830 None] Deleting attachment 567d6876-65be-417c-8afe-f4e02069bf08. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "cinder-36ce2d30-20e1-4d88-9319-e791bf3fa797-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-36ce2d30-20e1-4d88-9319-e791bf3fa797-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:05:49 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "cinder-quobyte-36ce2d30-20e1-4d88-9319-e791bf3fa797" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-quobyte-36ce2d30-20e1-4d88-9319-e791bf3fa797" acquired by "delete_volume" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82e750e-64cc-488f-9a0c-52818bf2bed7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797" returned: 0 in 0.463s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:05:49 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-36ce2d30-20e1-4d88-9319-e791bf3fa797" returned: 0 in 0.098s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-quobyte-36ce2d30-20e1-4d88-9319-e791bf3fa797" released by "delete_volume" :: held 0.735s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:05:50 devstack cinder-volume[83645]: WARNING cinder.quota [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-208833674-281283365 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-208833674-281283365, it is now deprecated. Please use the default quota class for default quota.
Sep 17 08:05:50 devstack cinder-volume[83645]: WARNING cinder.quota [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-208833674-281283365 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-208833674-281283365, it is now deprecated. Please use the default quota class for default quota.
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Created reservations ['2bb5b3dd-64e0-45df-a4aa-f644fedd8c07', '70ed3fbe-aa3b-44be-a3d0-b3386d5f7e2e', '0fff97a6-0f6d-486f-8e6a-54dee8aeaa4a', '6e68be86-da57-4673-9af9-64e190700d91'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.096s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:05:50 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Deleted volume successfully.
Sep 17 08:05:50 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-4798f696-7124-4775-a7ca-b47c2f3c927d tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-36ce2d30-20e1-4d88-9319-e791bf3fa797-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:06:00 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=5 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:06:00 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=12,cinder:SELECT=5,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:06:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-33fd110b-0f37-43a1-9b0b-323f7a4651f5 req-48de0c3a-4cc2-49c0-ae12-7d105ee832f5 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:06:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-33fd110b-0f37-43a1-9b0b-323f7a4651f5 req-48de0c3a-4cc2-49c0-ae12-7d105ee832f5 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:06:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-33fd110b-0f37-43a1-9b0b-323f7a4651f5 req-48de0c3a-4cc2-49c0-ae12-7d105ee832f5 tempest-TestInstancesWithCinderVolumes-184934830 None] Terminate volume connection completed successfully.
Sep 17 08:06:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-33fd110b-0f37-43a1-9b0b-323f7a4651f5 req-48de0c3a-4cc2-49c0-ae12-7d105ee832f5 tempest-TestInstancesWithCinderVolumes-184934830 None] Deleting attachment 27b8de9d-fbcb-4618-9827-32874d317a8b. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 08:06:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "cinder-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:06:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:06:19 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:06:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "cinder-quobyte-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:06:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-quobyte-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" acquired by "delete_volume" :: waited 0.031s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:06:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dad3136-4567-4ab0-b3b3-4fe29edb3c4a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:06:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" returned: 0 in 0.659s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" returned: 0 in 0.142s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-quobyte-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960" released by "delete_volume" :: held 1.047s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:06:20 devstack cinder-volume[83645]: WARNING cinder.quota [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1984921451-1467440929 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1984921451-1467440929, it is now deprecated. Please use the default quota class for default quota.
Sep 17 08:06:20 devstack cinder-volume[83645]: WARNING cinder.quota [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1984921451-1467440929 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1984921451-1467440929, it is now deprecated. Please use the default quota class for default quota.
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Created reservations ['c0550a49-f63b-49f8-bdf9-45bfa96c1962', '0786d918-acb0-4f51-9f62-078420b60d42', '4afd8da1-8a0d-4ff8-895a-07a9ecbc13c3', 'cfc0c9b2-40ed-496a-ab0a-13e01f329500'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:06:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.160s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:21 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:06:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Deleted volume successfully.
Sep 17 08:06:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-c09165f1-1a4e-4823-9fd5-9edfaa496ada tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-10e6662d-8e8e-42fe-8aa8-7d3bc2ee8960-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:06:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-477835b4-3eaa-48a8-a8a9-e8cdbb550f5d req-df3a4e0a-6b3d-4d1c-bb4c-f46e63f2e4c3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:06:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-477835b4-3eaa-48a8-a8a9-e8cdbb550f5d req-df3a4e0a-6b3d-4d1c-bb4c-f46e63f2e4c3 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:06:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-477835b4-3eaa-48a8-a8a9-e8cdbb550f5d req-df3a4e0a-6b3d-4d1c-bb4c-f46e63f2e4c3 tempest-TestInstancesWithCinderVolumes-184934830 None] Terminate volume connection completed successfully.
Sep 17 08:06:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-477835b4-3eaa-48a8-a8a9-e8cdbb550f5d req-df3a4e0a-6b3d-4d1c-bb4c-f46e63f2e4c3 tempest-TestInstancesWithCinderVolumes-184934830 None] Deleting attachment 3705f968-c6b7-4344-af7e-c31b026453e7. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 08:06:30 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:06:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "cinder-e14f8d03-3424-4645-8f0e-dcd1523aa717-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:06:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-e14f8d03-3424-4645-8f0e-dcd1523aa717-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:06:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:06:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "cinder-quobyte-e14f8d03-3424-4645-8f0e-dcd1523aa717" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:06:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-quobyte-e14f8d03-3424-4645-8f0e-dcd1523aa717" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:06:32 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e6505b-df4e-43a6-a3a4-275ecdc53286]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:06:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 0 in 0.360s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 1 in 0.382s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e14f8d03-3424-4645-8f0e-dcd1523aa717" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-quobyte-e14f8d03-3424-4645-8f0e-dcd1523aa717" released by "delete_volume" :: held 1.095s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:06:33 devstack cinder-volume[83645]: WARNING cinder.quota [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1655171484-1047276749 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1655171484-1047276749, it is now deprecated. Please use the default quota class for default quota.
Sep 17 08:06:33 devstack cinder-volume[83645]: WARNING cinder.quota [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1655171484-1047276749 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1655171484-1047276749, it is now deprecated. Please use the default quota class for default quota.
Sep 17 08:06:33 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Created reservations ['d1b57567-58e4-4723-9bfa-94051e8442ac', 'd05d7559-163c-46ee-ab75-2e1506a19d33', '84497b14-2913-4971-8a44-8083f8b3ec96', '12faca3e-dec8-434a-ba7f-6db737e5df01'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.087s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:06:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Deleted volume successfully.
Sep 17 08:06:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-db9e7712-eb1c-4a23-a302-6a29e9c547f7 tempest-TestInstancesWithCinderVolumes-184934830 None] Lock "cinder-e14f8d03-3424-4645-8f0e-dcd1523aa717-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:06:44 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:06:44 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.088s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:06:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.087s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:07:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:07:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.104s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:08:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:08:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Flow 'volume_create_manager' (2b1beaff-2e57-4cda-8835-e86a146c5526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224c7d56-45de-4179-b877-106e9f556c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224c7d56-45de-4179-b877-106e9f556c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1535617689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fc92a2-e6b3-4848-8e3a-c5e9f53766d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080543388b644275b6e1dd34e5717605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:48Z,use_quota=True,user_id='93f6ad0ede924c528e297146b0fd2faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee18beb-6ee4-480e-9622-217854377a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee18beb-6ee4-480e-9622-217854377a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ea4b3c-d281-4aa8-b192-f1363a673cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ea4b3c-d281-4aa8-b192-f1363a673cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50fc92a2-e6b3-4848-8e3a-c5e9f53766d8', 'volume_name': 'volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab68b2bf-d93d-4d88-8c68-220c5f7d4d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab68b2bf-d93d-4d88-8c68-220c5f7d4d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db47a0f-1721-4744-93d6-32bd3985ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:08:48 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume 50fc92a2-e6b3-4848-8e3a-c5e9f53766d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8', 'volume_size': 1}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1535617689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fc92a2-e6b3-4848-8e3a-c5e9f53766d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080543388b644275b6e1dd34e5717605',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:48Z,use_quota=True,user_id='93f6ad0ede924c528e297146b0fd2faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Creating volume 50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:08:48 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:08:48 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=137, name=volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 1073741824" returned: 0 in 0.375s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] <== create_volume: return (542ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:08:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.555s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:08:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db47a0f-1721-4744-93d6-32bd3985ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:08:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc4a743-59e7-4be9-a62b-e6533602cc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:08:49 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 (50fc92a2-e6b3-4848-8e3a-c5e9f53766d8): created successfully
Sep 17 08:08:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc4a743-59e7-4be9-a62b-e6533602cc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:08:49 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Flow 'volume_create_manager' (2b1beaff-2e57-4cda-8835-e86a146c5526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:08:49 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-77024a6a-88e8-4e75-a3ed-d2e0977c04e3 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Created volume successfully.
Sep 17 08:08:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:08:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:08:53 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f2e59-4df1-46cf-acbc-cdde5c405ea7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:08:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:08:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" returned: 0 in 0.460s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:08:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.519s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:08:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24a4c170-d7d5-4cd2-a82f-48805291c9f1', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 08:08:54 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:08:54 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-f717b4c3-baea-4aba-82e9-6a9827f5581d req-e18d0392-0f75-4c07-8c3f-6b4ef5c893f5 tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] attachment_update completed successfully.
Sep 17 08:09:04 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:09:04 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:09:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-ca126cc2-d0e7-4c5d-a8a9-cf355051c447 req-725e4a8d-9b93-4375-afb3-e95c6a5eb69d tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:09:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-ca126cc2-d0e7-4c5d-a8a9-cf355051c447 req-725e4a8d-9b93-4375-afb3-e95c6a5eb69d tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:09:24 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-ca126cc2-d0e7-4c5d-a8a9-cf355051c447 req-725e4a8d-9b93-4375-afb3-e95c6a5eb69d tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Terminate volume connection completed successfully.
Sep 17 08:09:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-ca126cc2-d0e7-4c5d-a8a9-cf355051c447 req-725e4a8d-9b93-4375-afb3-e95c6a5eb69d tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Deleting attachment 24a4c170-d7d5-4cd2-a82f-48805291c9f1. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Acquiring lock "cinder-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "cinder-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:09:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Acquiring lock "cinder-quobyte-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "cinder-quobyte-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4742ec4-1929-4821-892b-57e24b8ff8ce]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" returned: 0 in 0.407s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:09:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "cinder-quobyte-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8" released by "delete_volume" :: held 0.655s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Created reservations ['34767913-c736-45cf-b73e-4f0307c83536', '2bf26411-3b84-4672-a071-f2bd7a215fee', 'e5c3f08a-44c7-4ea6-b6c1-6bf793684805', 'da2ec2d2-bd34-48c8-b812-c4870d3e47ad'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.118s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:09:27 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Deleted volume successfully.
Sep 17 08:09:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-50464b50-9800-4d4e-b493-8b8051bd675c tempest-TestServerVolumeAttachScenarioOldVersion-900893872 None] Lock "cinder-50fc92a2-e6b3-4848-8e3a-c5e9f53766d8-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:09:37 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=11 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:09:37 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.132s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:09:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:09:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:09:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:10:13 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:10:13 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Flow 'volume_create_manager' (0ae0881d-c326-47d4-a0a4-335bd5fbe178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb17a05-e71e-4772-a571-6d49527633a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbb17a05-e71e-4772-a571-6d49527633a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-893579363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69274be6-1e77-422c-a6b5-bb38c575a791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c4380046b543e68777b708e36facfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:10:14Z,use_quota=True,user_id='5fdbab7412264703b54391ab81549e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b132ca61-3856-418a-9d4c-c3563591f6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b132ca61-3856-418a-9d4c-c3563591f6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c713e9-60fc-4f95-9eeb-fb307437a3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c713e9-60fc-4f95-9eeb-fb307437a3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69274be6-1e77-422c-a6b5-bb38c575a791', 'volume_name': 'volume-69274be6-1e77-422c-a6b5-bb38c575a791', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f702ad2c-9997-4902-91aa-843c4695a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f702ad2c-9997-4902-91aa-843c4695a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e47646-e482-4b2c-83a8-32c62623e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:14 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume 69274be6-1e77-422c-a6b5-bb38c575a791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69274be6-1e77-422c-a6b5-bb38c575a791', 'volume_size': 1}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-893579363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69274be6-1e77-422c-a6b5-bb38c575a791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c4380046b543e68777b708e36facfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:10:14Z,use_quota=True,user_id='5fdbab7412264703b54391ab81549e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Creating volume 69274be6-1e77-422c-a6b5-bb38c575a791 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:10:14 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:10:14 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=138, name=volume-69274be6-1e77-422c-a6b5-bb38c575a791, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791 1073741824" returned: 0 in 0.691s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:10:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:10:15 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Flow 'volume_create_manager' (d1909387-4e3a-4fa8-b79d-58606fffbec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08181df5-3f63-49ca-8e71-63c056c3a43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791" returned: 0 in 0.610s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] <== create_volume: return (1373ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08181df5-3f63-49ca-8e71-63c056c3a43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-983283008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7294cb0a-dfb8-419a-b8b5-3210bf60fe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c4380046b543e68777b708e36facfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:10:14Z,use_quota=True,user_id='5fdbab7412264703b54391ab81549e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff76e5e-7164-41db-97fe-b058d3d6b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff76e5e-7164-41db-97fe-b058d3d6b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720db8ab-a035-4a71-9af4-f15d421f194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720db8ab-a035-4a71-9af4-f15d421f194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7294cb0a-dfb8-419a-b8b5-3210bf60fe34', 'volume_name': 'volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d375c015-aab1-4f40-a8dd-19293f6bd908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d375c015-aab1-4f40-a8dd-19293f6bd908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0fc9c0-7ec5-469f-8734-6dab94ba9f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:15 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume 7294cb0a-dfb8-419a-b8b5-3210bf60fe34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34', 'volume_size': 1}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-983283008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7294cb0a-dfb8-419a-b8b5-3210bf60fe34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c4380046b543e68777b708e36facfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:10:14Z,use_quota=True,user_id='5fdbab7412264703b54391ab81549e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Creating volume 7294cb0a-dfb8-419a-b8b5-3210bf60fe34 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:10:15 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:10:15 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=139, name=volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e47646-e482-4b2c-83a8-32c62623e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69274be6-1e77-422c-a6b5-bb38c575a791', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da63994e-cf74-4801-86e1-be7f5e98a893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 1073741824" returned: 0 in 0.490s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:10:16 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume volume-69274be6-1e77-422c-a6b5-bb38c575a791 (69274be6-1e77-422c-a6b5-bb38c575a791): created successfully
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da63994e-cf74-4801-86e1-be7f5e98a893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Flow 'volume_create_manager' (0ae0881d-c326-47d4-a0a4-335bd5fbe178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" returned: 0 in 0.364s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:10:16 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f555a634-47ca-4286-938f-1a8032838bc5 tempest-TestServerVolumeAttachmentScenario-315130037 None] Created volume successfully.
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0fc9c0-7ec5-469f-8734-6dab94ba9f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1f538a-749f-4e70-ad5d-a787c04722be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:10:16 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 (7294cb0a-dfb8-419a-b8b5-3210bf60fe34): created successfully
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d1f538a-749f-4e70-ad5d-a787c04722be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:10:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Flow 'volume_create_manager' (d1909387-4e3a-4fa8-b79d-58606fffbec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:10:16 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-611edf7c-c90f-436d-b84f-4783865cbb2d tempest-TestServerVolumeAttachmentScenario-315130037 None] Created volume successfully.
Sep 17 08:10:26 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:10:26 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:10:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:11:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:11:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:11:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:11:50 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e337dd5-b1c9-4078-8fcf-e1dbfc14997a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:11:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:11:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791" returned: 0 in 0.410s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:11:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.475s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:11:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-69274be6-1e77-422c-a6b5-bb38c575a791', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16e1e503-5e7b-4681-a544-45af170d4504', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 08:11:51 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:11:51 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-f7d508b8-5c1a-4813-a52e-621fa863f9f0 req-32d780d6-b123-46b0-9474-8319341d021d tempest-TestServerVolumeAttachmentScenario-315130037 None] attachment_update completed successfully.
Sep 17 08:12:01 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:12:01 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:12:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:12:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:12:03 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f83082-e6f6-4e2c-8593-4c0722e25e8b]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:12:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:12:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" returned: 0 in 0.382s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:12:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.436s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:12:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26', 'name': 'volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '875b3537-2744-4ffc-99b3-81504f03f6f8', 'enforce_multipath': True} {{(pid=83645) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 17 08:12:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:12:04 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-e8aca767-e36f-4e3c-aab5-16c6204acaad req-2afc8b67-52af-444f-814c-a1573f14113b tempest-TestServerVolumeAttachmentScenario-315130037 None] attachment_update completed successfully.
Sep 17 08:12:14 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:12:14 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:12:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-b91ba9e1-f0b4-4fbb-97c4-876b8fd5cbea req-c6dad7a5-bfa6-4880-a09e-6a78393f8994 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:12:32 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-b91ba9e1-f0b4-4fbb-97c4-876b8fd5cbea req-c6dad7a5-bfa6-4880-a09e-6a78393f8994 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:12:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-b91ba9e1-f0b4-4fbb-97c4-876b8fd5cbea req-c6dad7a5-bfa6-4880-a09e-6a78393f8994 tempest-TestServerVolumeAttachmentScenario-315130037 None] Terminate volume connection completed successfully.
Sep 17 08:12:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-b91ba9e1-f0b4-4fbb-97c4-876b8fd5cbea req-c6dad7a5-bfa6-4880-a09e-6a78393f8994 tempest-TestServerVolumeAttachmentScenario-315130037 None] Deleting attachment 875b3537-2744-4ffc-99b3-81504f03f6f8. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 08:12:42 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=2 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.082s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:12:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:12:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-6fac9bd9-396e-424c-9eb9-29444607a4ec req-a6ca774f-521d-43b4-a748-a65f8d6b85e2 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:12:56 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [req-6fac9bd9-396e-424c-9eb9-29444607a4ec req-a6ca774f-521d-43b4-a748-a65f8d6b85e2 tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:12:56 devstack cinder-volume[83645]: INFO cinder.volume.manager [req-6fac9bd9-396e-424c-9eb9-29444607a4ec req-a6ca774f-521d-43b4-a748-a65f8d6b85e2 tempest-TestServerVolumeAttachmentScenario-315130037 None] Terminate volume connection completed successfully.
Sep 17 08:12:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [req-6fac9bd9-396e-424c-9eb9-29444607a4ec req-a6ca774f-521d-43b4-a748-a65f8d6b85e2 tempest-TestServerVolumeAttachmentScenario-315130037 None] Deleting attachment 16e1e503-5e7b-4681-a544-45af170d4504. {{(pid=83645) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 17 08:13:06 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:13:06 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "cinder-7294cb0a-dfb8-419a-b8b5-3210bf60fe34-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-7294cb0a-dfb8-419a-b8b5-3210bf60fe34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:08 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "cinder-quobyte-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-quobyte-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" acquired by "delete_volume" :: waited 0.011s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d90ff63-da80-4f3e-a769-b7727b3f9b06]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" returned: 0 in 0.379s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-quobyte-7294cb0a-dfb8-419a-b8b5-3210bf60fe34" released by "delete_volume" :: held 0.652s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Created reservations ['5173637f-5b92-4db8-8b14-26f726ca4dde', '4cd1d947-2186-4ca9-bbab-eab6b80d639b', '1b07b946-e7e8-4248-b141-df31050daf26', 'c65392e1-f9fb-4046-bae4-827eff2ccecf'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "cinder-69274be6-1e77-422c-a6b5-bb38c575a791-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.257s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Deleted volume successfully.
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-69274be6-1e77-422c-a6b5-bb38c575a791-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da8a88f2-b58d-408b-9dae-e96fd4f5ab0b tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-7294cb0a-dfb8-419a-b8b5-3210bf60fe34-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "cinder-quobyte-69274be6-1e77-422c-a6b5-bb38c575a791" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-quobyte-69274be6-1e77-422c-a6b5-bb38c575a791" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd5c5f3-8a72-4c07-bc42-efaf2b875638]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791" returned: 0 in 0.417s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-69274be6-1e77-422c-a6b5-bb38c575a791" returned: 0 in 0.079s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-quobyte-69274be6-1e77-422c-a6b5-bb38c575a791" released by "delete_volume" :: held 0.642s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:10 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Created reservations ['6fa3524c-f221-420c-97a1-5dcf366d9b5b', '554bdf38-97a8-4cbd-aaa6-01d308100c5c', '5db78189-04cd-4da1-b433-b399a4c45073', 'c0eb71b1-dbdc-4864-8a6f-b7e0e3fb0226'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.093s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Deleted volume successfully.
Sep 17 08:13:11 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cf2545ab-5fd5-41ad-874d-5f34319e3b5e tempest-TestServerVolumeAttachmentScenario-315130037 None] Lock "cinder-69274be6-1e77-422c-a6b5-bb38c575a791-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:21 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:13:21 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=8,cinder:UPDATE=16,cinder:INSERT=8,cinder:DELETE=1 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:13:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:24 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:13:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (b5dc275e-2c27-43f3-8d14-ad8c5653f8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:24 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7f5c6f-5be3-4b11-83fd-01432337bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7f5c6f-5be3-4b11-83fd-01432337bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902521970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0f8eca-adf2-4932-bf20-f5dbb0e80baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:25Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d214dda8-6e54-43e8-b98f-743bbdef9a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d214dda8-6e54-43e8-b98f-743bbdef9a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4b183a-82c7-4adc-9971-4fc695b9f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4b183a-82c7-4adc-9971-4fc695b9f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0f8eca-adf2-4932-bf20-f5dbb0e80baf', 'volume_name': 'volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e34fc75-d8a7-4862-94d3-e08cbbbaab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e34fc75-d8a7-4862-94d3-e08cbbbaab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe003d-a410-48a8-bc6b-88ed2d47687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:25 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume 1d0f8eca-adf2-4932-bf20-f5dbb0e80baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf', 'volume_size': 1}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902521970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0f8eca-adf2-4932-bf20-f5dbb0e80baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:25Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Creating volume 1d0f8eca-adf2-4932-bf20-f5dbb0e80baf {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:13:25 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:25 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=140, name=volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf 1073741824" returned: 0 in 0.366s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf" returned: 0 in 0.114s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] <== create_volume: return (558ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:13:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.573s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fe003d-a410-48a8-bc6b-88ed2d47687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7f9c6e-bf6e-4e36-a697-502dd2f1d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:26 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf (1d0f8eca-adf2-4932-bf20-f5dbb0e80baf): created successfully
Sep 17 08:13:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7f9c6e-bf6e-4e36-a697-502dd2f1d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (b5dc275e-2c27-43f3-8d14-ad8c5653f8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:26 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-03d888af-87e4-4d8f-83ba-4a1521d4312d tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created volume successfully.
Sep 17 08:13:27 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (d82de721-3712-4f00-8d7b-e8f741364934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ce3122-8a44-4cf4-b3ae-44fbd89aff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ce3122-8a44-4cf4-b3ae-44fbd89aff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39440992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82df835f-a551-4b68-9e50-7e7f79ed61e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:27Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945a6115-c5de-4697-a712-6163a4cf8561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (945a6115-c5de-4697-a712-6163a4cf8561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a5daf2-7e1c-4933-a41a-c0f471ad1bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a5daf2-7e1c-4933-a41a-c0f471ad1bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82df835f-a551-4b68-9e50-7e7f79ed61e7', 'volume_name': 'volume-82df835f-a551-4b68-9e50-7e7f79ed61e7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d437e4-2f1d-4bfb-aec8-974ddb1c5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d437e4-2f1d-4bfb-aec8-974ddb1c5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87462433-6094-4b1f-971e-b2809ef6a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:27 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume 82df835f-a551-4b68-9e50-7e7f79ed61e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82df835f-a551-4b68-9e50-7e7f79ed61e7', 'volume_size': 1}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39440992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82df835f-a551-4b68-9e50-7e7f79ed61e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:27Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Creating volume 82df835f-a551-4b68-9e50-7e7f79ed61e7 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:13:27 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:13:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:27 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=141, name=volume-82df835f-a551-4b68-9e50-7e7f79ed61e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7 1073741824" returned: 0 in 0.584s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (62ec8532-d64c-4434-9015-660698b7a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925b8abc-5744-47d8-8837-862d70083391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:28 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (683c36bf-f67e-4565-af89-4407f6fbdfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d275e1-161b-4ff5-8daa-64ec3f53012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925b8abc-5744-47d8-8837-862d70083391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958040340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd873ff1-6db9-4fd8-beeb-c5db38c39d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:28Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b3adc2-3f73-4861-b91b-ee4ceb2ba8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b3adc2-3f73-4861-b91b-ee4ceb2ba8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e471b30-dd45-4379-89f5-423a13bc0f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e471b30-dd45-4379-89f5-423a13bc0f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd873ff1-6db9-4fd8-beeb-c5db38c39d43', 'volume_name': 'volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a144cf-4549-4a70-a12b-a6fdb6b20421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a144cf-4549-4a70-a12b-a6fdb6b20421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c033964f-fb5f-4463-9c2d-fda0baecd957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:28 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume fd873ff1-6db9-4fd8-beeb-c5db38c39d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43', 'volume_size': 1}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7" returned: 0 in 0.619s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] <== create_volume: return (1236ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958040340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd873ff1-6db9-4fd8-beeb-c5db38c39d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:28Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Creating volume fd873ff1-6db9-4fd8-beeb-c5db38c39d43 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:13:28 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:13:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:28 devstack quobyte-client[83654]: System call of process 100779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:13:28 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=142, name=volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d275e1-161b-4ff5-8daa-64ec3f53012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165386070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b90a5c-5381-42f0-b015-b8ee62a2d5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:28Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983645f1-9e2d-471d-adc2-2701dc7e0085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983645f1-9e2d-471d-adc2-2701dc7e0085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abfa29d-c0bb-42d3-a349-63f0f4f6c2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abfa29d-c0bb-42d3-a349-63f0f4f6c2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b90a5c-5381-42f0-b015-b8ee62a2d5e9', 'volume_name': 'volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5d4db-5302-48b1-92b1-3ca418956675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5d4db-5302-48b1-92b1-3ca418956675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a8c189-fce0-4b1e-b576-b2fed29b7944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume 61b90a5c-5381-42f0-b015-b8ee62a2d5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9', 'volume_size': 1}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87462433-6094-4b1f-971e-b2809ef6a043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82df835f-a551-4b68-9e50-7e7f79ed61e7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a81ff-a1ca-4b90-8767-998c6ee395d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (97e1ddd8-2f8b-471c-91d9-d58adc2840aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0a0322-2989-4166-a71b-db05bacfa6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43 1073741824" returned: 0 in 0.615s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume volume-82df835f-a551-4b68-9e50-7e7f79ed61e7 (82df835f-a551-4b68-9e50-7e7f79ed61e7): created successfully
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582a81ff-a1ca-4b90-8767-998c6ee395d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (d82de721-3712-4f00-8d7b-e8f741364934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0a0322-2989-4166-a71b-db05bacfa6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-549330181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7551e7-6a03-46f2-ad08-a458cbf6d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:28Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ea30d1-62cd-496c-b739-c818ab2d6ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ea30d1-62cd-496c-b739-c818ab2d6ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ddb0b4-764f-4cf6-9c67-9664e4deb2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ddb0b4-764f-4cf6-9c67-9664e4deb2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7551e7-6a03-46f2-ad08-a458cbf6d8c3', 'volume_name': 'volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c15b0-72ce-48d2-9494-4eff9028cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e8c15b0-72ce-48d2-9494-4eff9028cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1497db91-c930-4959-b921-406b820bef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:29 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume 0e7551e7-6a03-46f2-ad08-a458cbf6d8c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3', 'volume_size': 1}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43" returned: 0 in 0.395s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] <== create_volume: return (1030ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165386070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b90a5c-5381-42f0-b015-b8ee62a2d5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:28Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Creating volume 61b90a5c-5381-42f0-b015-b8ee62a2d5e9 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:13:29 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:13:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:29 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=143, name=volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:13:30 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7fe3c10c-f0fb-4abf-9009-2931a728f5ab tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created volume successfully.
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c033964f-fb5f-4463-9c2d-fda0baecd957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7268cae-b112-4b3e-9bd8-181cbb7aa87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (47ccf989-e896-4540-83ae-984e54656e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80e97d4-d054-4c90-aadf-63c049a3d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9 1073741824" returned: 0 in 0.572s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43 (fd873ff1-6db9-4fd8-beeb-c5db38c39d43): created successfully
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7268cae-b112-4b3e-9bd8-181cbb7aa87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (62ec8532-d64c-4434-9015-660698b7a50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80e97d4-d054-4c90-aadf-63c049a3d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206821096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99732b3-1a5d-4f23-9971-7949b61350e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:29Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ce3b22-5a0c-4a7e-80d0-d8ea90e0b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ce3b22-5a0c-4a7e-80d0-d8ea90e0b8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0c7c14-991a-45c3-96f1-8cbdefd3f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0c7c14-991a-45c3-96f1-8cbdefd3f076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99732b3-1a5d-4f23-9971-7949b61350e4', 'volume_name': 'volume-f99732b3-1a5d-4f23-9971-7949b61350e4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cda7db-cdb5-42f7-beb7-be528353d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cda7db-cdb5-42f7-beb7-be528353d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b81e751-c5a9-4f68-8fbf-67e554036b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:30 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume f99732b3-1a5d-4f23-9971-7949b61350e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99732b3-1a5d-4f23-9971-7949b61350e4', 'volume_size': 1}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9" returned: 0 in 0.356s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] <== create_volume: return (949ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-549330181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7551e7-6a03-46f2-ad08-a458cbf6d8c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:28Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Creating volume 0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:13:30 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:13:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:30 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=144, name=volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:13:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-eee75f0e-31c0-43c4-a18b-32b6ec8958ad tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created volume successfully.
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a8c189-fce0-4b1e-b576-b2fed29b7944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e016f7b2-7c18-493b-8989-81ce44d591c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 1073741824" returned: 0 in 0.466s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:31 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9 (61b90a5c-5381-42f0-b015-b8ee62a2d5e9): created successfully
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e016f7b2-7c18-493b-8989-81ce44d591c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (683c36bf-f67e-4565-af89-4407f6fbdfde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3" returned: 0 in 0.288s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206821096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99732b3-1a5d-4f23-9971-7949b61350e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21bf05902ef4f72a19ad8e83b69295c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:13:29Z,use_quota=True,user_id='bd18e285d82a4af2afc3154d14f5828a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Creating volume f99732b3-1a5d-4f23-9971-7949b61350e4 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:13:31 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:31 devstack quobyte-client[83654]: System call of process 100793 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:13:31 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=145, name=volume-f99732b3-1a5d-4f23-9971-7949b61350e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:13:31 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-aeede784-06ea-40d1-bd86-ec5d2be4c4b5 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created volume successfully.
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1497db91-c930-4959-b921-406b820bef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cc5b79-8a1a-4503-b54a-6bc077fc0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4 1073741824" returned: 0 in 0.368s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:32 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 (0e7551e7-6a03-46f2-ad08-a458cbf6d8c3): created successfully
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cc5b79-8a1a-4503-b54a-6bc077fc0424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (97e1ddd8-2f8b-471c-91d9-d58adc2840aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4" returned: 0 in 0.322s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] <== create_volume: return (717ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-714df4ef-b1a9-4805-b512-f6580660ab03 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created volume successfully.
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b81e751-c5a9-4f68-8fbf-67e554036b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99732b3-1a5d-4f23-9971-7949b61350e4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeface8-5e7b-48f9-ab3e-8546f3b2aa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:13:32 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume volume-f99732b3-1a5d-4f23-9971-7949b61350e4 (f99732b3-1a5d-4f23-9971-7949b61350e4): created successfully
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeface8-5e7b-48f9-ab3e-8546f3b2aa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:13:32 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Flow 'volume_create_manager' (47ccf989-e896-4540-83ae-984e54656e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:13:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-24c5d352-6c35-4a33-980f-24aaa5914d22 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created volume successfully.
Sep 17 08:13:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-f99732b3-1a5d-4f23-9971-7949b61350e4-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-f99732b3-1a5d-4f23-9971-7949b61350e4-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-quobyte-f99732b3-1a5d-4f23-9971-7949b61350e4" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-f99732b3-1a5d-4f23-9971-7949b61350e4" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:33 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2bdadc-663a-4d27-91b6-a98dc75b334e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4" returned: 0 in 0.394s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-f99732b3-1a5d-4f23-9971-7949b61350e4" returned: 0 in 0.106s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-f99732b3-1a5d-4f23-9971-7949b61350e4" released by "delete_volume" :: held 0.651s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created reservations ['5472c71d-ac5a-4a1c-877d-1139997b4ab6', 'f4784ce6-ba01-4583-97ef-daebe376b95e', '2ee42edd-b806-4ec5-a2fd-1330b8f32929', 'af819dbd-1183-419f-a257-7adddb48393e'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:34 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:34 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Deleted volume successfully.
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-5ef498a1-a91a-4b05-bff2-987ca755c7b6 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-f99732b3-1a5d-4f23-9971-7949b61350e4-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:35 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-quobyte-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3" acquired by "delete_volume" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2db7ac9-a548-4626-8660-f4560e5d22e4]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3" returned: 0 in 0.401s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3" returned: 0 in 0.117s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3" released by "delete_volume" :: held 0.664s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created reservations ['da341684-50cb-4da2-a37e-777e3a08e82d', '9bde3efa-2bd9-478f-b9f8-cb7e27765334', '1552b0f8-8e5e-474c-a7e9-f0c50d59a85c', '78cc6d3e-a1f2-4da0-b557-8120ac7c5c60'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.109s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:37 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Deleted volume successfully.
Sep 17 08:13:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0127dd2e-7233-4273-ab12-8e866742c7ca tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-0e7551e7-6a03-46f2-ad08-a458cbf6d8c3-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-61b90a5c-5381-42f0-b015-b8ee62a2d5e9-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-61b90a5c-5381-42f0-b015-b8ee62a2d5e9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:38 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-quobyte-61b90a5c-5381-42f0-b015-b8ee62a2d5e9" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-61b90a5c-5381-42f0-b015-b8ee62a2d5e9" acquired by "delete_volume" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6114e8-fe3f-44eb-95b1-2b4cf8583d99]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9" returned: 0 in 0.392s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-61b90a5c-5381-42f0-b015-b8ee62a2d5e9" returned: 0 in 0.085s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-61b90a5c-5381-42f0-b015-b8ee62a2d5e9" released by "delete_volume" :: held 0.639s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created reservations ['37f32a4b-a59f-45c2-9bc7-a464a104b7b2', 'bb30a249-3fa0-4c25-984d-66159b7236e7', '1ab1f4cb-87d7-4886-b193-b47294f15201', '1318970b-ba39-4553-8cda-25d954cd6c25'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.095s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Deleted volume successfully.
Sep 17 08:13:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-36037ede-4062-482c-a416-bbec5dff0c7c tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-61b90a5c-5381-42f0-b015-b8ee62a2d5e9-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-fd873ff1-6db9-4fd8-beeb-c5db38c39d43-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-fd873ff1-6db9-4fd8-beeb-c5db38c39d43-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-quobyte-fd873ff1-6db9-4fd8-beeb-c5db38c39d43" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-fd873ff1-6db9-4fd8-beeb-c5db38c39d43" acquired by "delete_volume" :: waited 0.008s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d71dff0-5272-4d50-bc8f-2f4f156ab303]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43" returned: 0 in 0.379s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-fd873ff1-6db9-4fd8-beeb-c5db38c39d43" returned: 0 in 0.100s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-fd873ff1-6db9-4fd8-beeb-c5db38c39d43" released by "delete_volume" :: held 0.629s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created reservations ['80ed6f2f-f063-46f6-9355-c451c3eb1cbb', 'b5e2c924-5e31-4007-80ed-1c9ff479d627', '97504062-1eab-43a7-9b07-4944ade8c803', 'd5d61e54-fff8-42d4-aa48-25e79b91d7c2'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-82df835f-a551-4b68-9e50-7e7f79ed61e7-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.272s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-82df835f-a551-4b68-9e50-7e7f79ed61e7-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Deleted volume successfully.
Sep 17 08:13:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0414d1d8-37ac-403d-adc3-c7110e1757db tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-fd873ff1-6db9-4fd8-beeb-c5db38c39d43-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-quobyte-82df835f-a551-4b68-9e50-7e7f79ed61e7" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-82df835f-a551-4b68-9e50-7e7f79ed61e7" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd8c107-1489-4c14-bdc1-ed2c5a3413d7]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7" returned: 0 in 0.388s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-82df835f-a551-4b68-9e50-7e7f79ed61e7" returned: 0 in 0.083s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-82df835f-a551-4b68-9e50-7e7f79ed61e7" released by "delete_volume" :: held 0.627s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:42 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created reservations ['6a98c66e-2794-4aa6-a414-cd5058480dfd', '36d58ff2-8def-4443-8075-15043da70881', '66626011-2d2f-4d7d-b0d4-e1ce94b2648a', '80df1032-be23-4413-b3c9-73df4c18fcab'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.084s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Deleted volume successfully.
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d9018261-bf35-4881-a7cf-ff58029bb7b1 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-82df835f-a551-4b68-9e50-7e7f79ed61e7-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "cinder-quobyte-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf" acquired by "delete_volume" :: waited 0.010s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d249d8-4de3-4b00-b7d0-118ab941d894]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf" returned: 0 in 0.385s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf" returned: 0 in 0.109s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-quobyte-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf" released by "delete_volume" :: held 0.642s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:44 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Created reservations ['a37ec189-f09a-414b-bc72-30c7bbaa2c1d', '7a99edef-ae3c-41b1-bef1-a6117b48d4f8', 'f9ac4136-f098-41a7-9a8c-dc8e9cdb72d1', '9ee1a103-2051-4160-a2a9-121a2961d4ae'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.105s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:45 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Deleted volume successfully.
Sep 17 08:13:45 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6b9fcffe-98ce-425b-af52-d9dc959770a7 tempest-CreateVolumesFromSourceVolumeTest-938897143 None] Lock "cinder-1d0f8eca-adf2-4932-bf20-f5dbb0e80baf-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.097s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:13:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:13:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=55,cinder:DELETE=9,cinder:SELECT=30,cinder:INSERT=14 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:13:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=43,cinder:UPDATE=66,cinder:DELETE=3,cinder:INSERT=10 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:14:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (91fe0587-8518-4edf-af66-c4f41cb147fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9342cb8-e0e1-4694-8728-2aa22a92ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (6d3c9c70-b8d6-4deb-8d89-86891ea36928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528ac6db-fcdf-42ef-a53f-57de62231beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9342cb8-e0e1-4694-8728-2aa22a92ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760855670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21a5f94-be41-4eb6-8a29-589472ae04f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22614c6-687c-4118-92a2-203e49887c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22614c6-687c-4118-92a2-203e49887c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755ff284-b508-437e-a3c6-49f46333e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755ff284-b508-437e-a3c6-49f46333e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21a5f94-be41-4eb6-8a29-589472ae04f7', 'volume_name': 'volume-b21a5f94-be41-4eb6-8a29-589472ae04f7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372fb7e8-9a34-44e3-975f-694d44f67895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372fb7e8-9a34-44e3-975f-694d44f67895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8bcba4-ffdc-40ed-8f75-6d74d5808a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Volume b21a5f94-be41-4eb6-8a29-589472ae04f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21a5f94-be41-4eb6-8a29-589472ae04f7', 'volume_size': 1}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760855670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21a5f94-be41-4eb6-8a29-589472ae04f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Creating volume b21a5f94-be41-4eb6-8a29-589472ae04f7 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:04 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:04 devstack quobyte-client[83654]: System call of process 100879 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:04 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=146, name=volume-b21a5f94-be41-4eb6-8a29-589472ae04f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528ac6db-fcdf-42ef-a53f-57de62231beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021349828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68d96f4-3540-4eb0-b465-64b993ce2e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879bb332-f54a-4b55-8dc2-5356f82331b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879bb332-f54a-4b55-8dc2-5356f82331b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da4fdf0-0a03-4960-9882-e08ddc3c7d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da4fdf0-0a03-4960-9882-e08ddc3c7d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c68d96f4-3540-4eb0-b465-64b993ce2e29', 'volume_name': 'volume-c68d96f4-3540-4eb0-b465-64b993ce2e29', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98aafe7f-71bd-4c9f-a132-0de7717866a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98aafe7f-71bd-4c9f-a132-0de7717866a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab898b0-ab39-41c8-8a61-98cb8ad27c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:04 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume c68d96f4-3540-4eb0-b465-64b993ce2e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c68d96f4-3540-4eb0-b465-64b993ce2e29', 'volume_size': 1}
Sep 17 08:14:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:04 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Flow 'volume_create_manager' (2785557f-c74c-4ae3-8a2a-62b6ea63f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e75280a-b440-4541-8eed-30031506a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e75280a-b440-4541-8eed-30031506a07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7755a91-50b2-49bb-890c-b2caf8dd2fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362225fae8640b9b935dd57953482b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='c2d19359e23141bea4e88762ceab89ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd76b98e-898b-4630-9c1e-54c13a11fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd76b98e-898b-4630-9c1e-54c13a11fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1278fae-b898-451e-b10b-48398adaccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1278fae-b898-451e-b10b-48398adaccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7755a91-50b2-49bb-890c-b2caf8dd2fc2', 'volume_name': 'volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5b2049-ebbc-4091-8502-3f8853026505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5b2049-ebbc-4091-8502-3f8853026505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16246fe1-471c-428a-b571-31847a42f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Volume d7755a91-50b2-49bb-890c-b2caf8dd2fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2', 'volume_size': 1}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:05 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (3c536134-5c8e-4193-9785-2da93442f074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a59ec8-d70c-4e30-804d-b36fb46d9b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7 1073741824" returned: 0 in 0.840s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:05 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (1410c12c-d2ee-496a-9bae-68ef13d4d605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e588da1-7777-42b8-8f44-b1c9862c9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e588da1-7777-42b8-8f44-b1c9862c9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003956041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b010cba-ec85-4cc3-899a-3679d0d79ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5820a1e-6556-4c3f-b110-dcc4205d3af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5820a1e-6556-4c3f-b110-dcc4205d3af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb89ed8a-58fe-46d5-a445-b32afeb5217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb89ed8a-58fe-46d5-a445-b32afeb5217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b010cba-ec85-4cc3-899a-3679d0d79ab7', 'volume_name': 'volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21237f8-4396-4fe3-84fa-3e734fd2a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21237f8-4396-4fe3-84fa-3e734fd2a732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6591b1e4-54a0-4e7b-ab93-6d3c5e7385f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Volume 1b010cba-ec85-4cc3-899a-3679d0d79ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7', 'volume_size': 1}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a59ec8-d70c-4e30-804d-b36fb46d9b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1746815742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc7a41a-7b55-4d75-bd6e-05953a5d80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:05Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c80433d-f6dd-404a-878a-a1388b9a7e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c80433d-f6dd-404a-878a-a1388b9a7e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4083354-067e-4030-acde-07cfafd9e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4083354-067e-4030-acde-07cfafd9e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc7a41a-7b55-4d75-bd6e-05953a5d80a4', 'volume_name': 'volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096d4ac9-a971-4a89-b844-0a7c32ce7b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096d4ac9-a971-4a89-b844-0a7c32ce7b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a721d474-0fff-4662-9002-f8b4a31b56a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:05 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Volume 0fc7a41a-7b55-4d75-bd6e-05953a5d80a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4', 'volume_size': 1}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7" returned: 0 in 0.541s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] <== create_volume: return (1453ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021349828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68d96f4-3540-4eb0-b465-64b993ce2e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Creating volume c68d96f4-3540-4eb0-b465-64b993ce2e29 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:05 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:05 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=147, name=volume-c68d96f4-3540-4eb0-b465-64b993ce2e29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:06 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (2a560c2c-5d6b-455a-be20-fe83393ae3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb8de49-15b4-49d5-ba20-748da9eff0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb8de49-15b4-49d5-ba20-748da9eff0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967448923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424dac81-65c1-4f12-8297-4af4b6fd36c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:05Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9202c57c-febc-45e0-8a71-ff8e00c12454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9202c57c-febc-45e0-8a71-ff8e00c12454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96353938-fe4d-487b-9c6f-e0da49a00970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96353938-fe4d-487b-9c6f-e0da49a00970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424dac81-65c1-4f12-8297-4af4b6fd36c4', 'volume_name': 'volume-424dac81-65c1-4f12-8297-4af4b6fd36c4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c8952a-73c8-4b15-a1b0-f064e480a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c8952a-73c8-4b15-a1b0-f064e480a86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09268199-22bf-4faa-99f8-bf20ba6d1a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Volume 424dac81-65c1-4f12-8297-4af4b6fd36c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424dac81-65c1-4f12-8297-4af4b6fd36c4', 'volume_size': 1}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8bcba4-ffdc-40ed-8f75-6d74d5808a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21a5f94-be41-4eb6-8a29-589472ae04f7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb60f59-afdc-4846-a99b-6a07f99d38b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29 1073741824" returned: 0 in 0.670s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:06 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (ab074929-dff1-4431-9bf6-c1479ba40c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3086edd-b75b-45f8-b688-0fbe61fcfe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3086edd-b75b-45f8-b688-0fbe61fcfe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306709569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbacd5a-0ed4-4e22-ae33-00cc43e83c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:06Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfd9afa-1fc9-4905-a558-5ef9e344ea02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfd9afa-1fc9-4905-a558-5ef9e344ea02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66898df5-f730-44a3-b338-7557f8a0d8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66898df5-f730-44a3-b338-7557f8a0d8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbacd5a-0ed4-4e22-ae33-00cc43e83c73', 'volume_name': 'volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04be4acb-e24a-43ce-91dd-513f9fbdeab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04be4acb-e24a-43ce-91dd-513f9fbdeab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45c116d-8185-49d2-8f1b-f73c4fc07f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:06 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Volume 7fbacd5a-0ed4-4e22-ae33-00cc43e83c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73', 'volume_size': 1}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:06 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Volume volume-b21a5f94-be41-4eb6-8a29-589472ae04f7 (b21a5f94-be41-4eb6-8a29-589472ae04f7): created successfully
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbb60f59-afdc-4846-a99b-6a07f99d38b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (91fe0587-8518-4edf-af66-c4f41cb147fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29" returned: 0 in 0.483s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] <== create_volume: return (1177ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7755a91-50b2-49bb-890c-b2caf8dd2fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362225fae8640b9b935dd57953482b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='c2d19359e23141bea4e88762ceab89ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Creating volume d7755a91-50b2-49bb-890c-b2caf8dd2fc2 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:07 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:07 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=148, name=volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:07 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f6185a7e-1016-4690-b92c-217ec45d4bf3 tempest-CreateVolumesFromImageTest-712397339 None] Created volume successfully.
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab898b0-ab39-41c8-8a61-98cb8ad27c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68d96f4-3540-4eb0-b465-64b993ce2e29', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146d1e31-47c9-4e90-930e-68033618da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:07 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume volume-c68d96f4-3540-4eb0-b465-64b993ce2e29 (c68d96f4-3540-4eb0-b465-64b993ce2e29): created successfully
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146d1e31-47c9-4e90-930e-68033618da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (6d3c9c70-b8d6-4deb-8d89-86891ea36928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2 1073741824" returned: 0 in 0.422s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2" returned: 0 in 0.146s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] <== create_volume: return (615ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.991s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2003956041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b010cba-ec85-4cc3-899a-3679d0d79ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:04Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Creating volume 1b010cba-ec85-4cc3-899a-3679d0d79ab7 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:07 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:07 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:07 devstack quobyte-client[83654]: System call of process 100891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:07 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=149, name=volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:07 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-00041c0b-c485-4e44-a855-63343dc565c3 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created volume successfully.
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16246fe1-471c-428a-b571-31847a42f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fa97a0-9196-4026-9961-5ab8f6741b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7 1073741824" returned: 0 in 0.421s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:08 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Volume volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2 (d7755a91-50b2-49bb-890c-b2caf8dd2fc2): created successfully
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9fa97a0-9196-4026-9961-5ab8f6741b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Flow 'volume_create_manager' (2785557f-c74c-4ae3-8a2a-62b6ea63f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7" returned: 0 in 0.335s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] <== create_volume: return (787ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.764s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1746815742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc7a41a-7b55-4d75-bd6e-05953a5d80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:05Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Creating volume 0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:08 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:08 devstack quobyte-client[83654]: System call of process 100895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:08 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=150, name=volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:08 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e7813f77-4135-480c-89f1-11cceb56b273 tempest-CinderUnicodeTest-186075768 None] Created volume successfully.
Sep 17 08:14:08 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6591b1e4-54a0-4e7b-ab93-6d3c5e7385f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1164df4e-ab4a-49c5-bf29-bea0db16a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 1073741824" returned: 0 in 0.593s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:09 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Volume volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7 (1b010cba-ec85-4cc3-899a-3679d0d79ab7): created successfully
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1164df4e-ab4a-49c5-bf29-bea0db16a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (1410c12c-d2ee-496a-9bae-68ef13d4d605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4" returned: 0 in 0.378s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-bba0b283-3b05-456d-b241-ceaf391eabd0 tempest-CreateVolumesFromImageTest-712397339 None] Created volume successfully.
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] <== create_volume: return (1059ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.196s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-967448923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424dac81-65c1-4f12-8297-4af4b6fd36c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:05Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Creating volume 424dac81-65c1-4f12-8297-4af4b6fd36c4 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:09 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:09 devstack quobyte-client[83654]: System call of process 100900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:09 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=151, name=volume-424dac81-65c1-4f12-8297-4af4b6fd36c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (ee050c2c-370c-4d40-b1a8-fbda9c5031fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0ae4ea-a423-4e3f-942d-249c93988a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a721d474-0fff-4662-9002-f8b4a31b56a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0a3a46-ca7c-48a9-9386-70fe2c19ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f0ae4ea-a423-4e3f-942d-249c93988a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-358986869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a8fbdc-044f-4a57-a913-c4ed9eaacb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:09Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50195ca-2e63-43c3-af30-60687b903fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50195ca-2e63-43c3-af30-60687b903fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4278593-55ff-4147-a84b-b8cfe20de4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4278593-55ff-4147-a84b-b8cfe20de4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a8fbdc-044f-4a57-a913-c4ed9eaacb89', 'volume_name': 'volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800780f3-454b-48fa-b452-80304f059a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800780f3-454b-48fa-b452-80304f059a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4267e213-031b-49d3-82ba-2a2e728bde39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume 22a8fbdc-044f-4a57-a913-c4ed9eaacb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89', 'volume_size': 1}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Flow 'volume_create_manager' (69ad7569-6863-45e0-aa32-756ec2ea70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23289d2-4ca1-473c-bfe8-d5ebfe24ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4 1073741824" returned: 0 in 1.057s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:10 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (d6864439-41ca-4ee7-8d45-f72c2f10e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952a639b-5269-47e7-ad50-c607b0b28900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:11 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Volume volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 (0fc7a41a-7b55-4d75-bd6e-05953a5d80a4): created successfully
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e0a3a46-ca7c-48a9-9386-70fe2c19ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (3c536134-5c8e-4193-9785-2da93442f074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23289d2-4ca1-473c-bfe8-d5ebfe24ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1236819424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4956ad95-e728-40c6-84d8-1065988dc35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362225fae8640b9b935dd57953482b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:10Z,use_quota=True,user_id='c2d19359e23141bea4e88762ceab89ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e3135f-e240-491c-b95f-d324b987dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e3135f-e240-491c-b95f-d324b987dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c24213-7ce2-4736-9f34-ae0f820e409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c24213-7ce2-4736-9f34-ae0f820e409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4956ad95-e728-40c6-84d8-1065988dc35f', 'volume_name': 'volume-4956ad95-e728-40c6-84d8-1065988dc35f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319155cf-8fbe-4531-8149-abc08dc8e1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319155cf-8fbe-4531-8149-abc08dc8e1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34368094-33ca-4ea1-b86a-e54aeec49cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Volume 4956ad95-e728-40c6-84d8-1065988dc35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4956ad95-e728-40c6-84d8-1065988dc35f', 'volume_size': 1}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952a639b-5269-47e7-ad50-c607b0b28900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1061545156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f7b3a0-9db8-40d8-8822-d144ba16a984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:10Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a389165-46f9-43d1-8986-9bf0c7f0760f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a389165-46f9-43d1-8986-9bf0c7f0760f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f39f186-c5f8-472a-8082-0cef280d4674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f39f186-c5f8-472a-8082-0cef280d4674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f7b3a0-9db8-40d8-8822-d144ba16a984', 'volume_name': 'volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e73dd5a-064e-4203-a9d9-21193b2ad14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e73dd5a-064e-4203-a9d9-21193b2ad14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8172bcdc-e7cf-41d3-b10c-b96931cf9c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume a1f7b3a0-9db8-40d8-8822-d144ba16a984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984', 'volume_size': 1}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d140017d-ba6e-4b11-baac-a9e1966ab13e tempest-CreateVolumesFromImageTest-712397339 None] Created volume successfully.
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4" returned: 0 in 0.664s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] <== create_volume: return (1783ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.504s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306709569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbacd5a-0ed4-4e22-ae33-00cc43e83c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82caadab103f454583ac758e4712b5e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:06Z,use_quota=True,user_id='7ca1c1cc6edd4e7eabb0c40794487a5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Creating volume 7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:11 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:11 devstack quobyte-client[83654]: System call of process 100907 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:11 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=152, name=volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:11 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (face64e5-e507-4ce7-8033-af329de89c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93deb74-dd63-47a5-a31e-7ea437d9768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:11 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (860ac126-0534-407d-9e92-f07c73c62a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:11 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fd155b-0c2d-437d-b72f-003ef9415fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (b6828045-4096-48ba-bcb8-0601222326c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb446dba-8e9d-4473-b988-493d02378731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09268199-22bf-4faa-99f8-bf20ba6d1a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424dac81-65c1-4f12-8297-4af4b6fd36c4', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780bee44-58c2-4666-a5b4-b384b99db1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93deb74-dd63-47a5-a31e-7ea437d9768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1829681716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8a8c6d-83f3-473b-91ab-65c09209f220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:11Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93b75ee-ce6f-42d0-a198-638fb4a43749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93b75ee-ce6f-42d0-a198-638fb4a43749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6c6f6a-7bd5-4eef-a194-dd8616b80189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6c6f6a-7bd5-4eef-a194-dd8616b80189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8a8c6d-83f3-473b-91ab-65c09209f220', 'volume_name': 'volume-2d8a8c6d-83f3-473b-91ab-65c09209f220', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d44b7e-b8ad-4b58-8623-5b84d24e8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d44b7e-b8ad-4b58-8623-5b84d24e8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016dffd6-986a-4a0a-acc5-b2d9eff41791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume 2d8a8c6d-83f3-473b-91ab-65c09209f220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8a8c6d-83f3-473b-91ab-65c09209f220', 'volume_size': 1}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fd155b-0c2d-437d-b72f-003ef9415fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1770652923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea4ba2e-0620-4870-b480-bfad22150b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:10Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aac091-5265-48d1-a3a6-66af2cf1e8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10aac091-5265-48d1-a3a6-66af2cf1e8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61efb9b1-ef2d-4090-9acf-75d7d1131f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61efb9b1-ef2d-4090-9acf-75d7d1131f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea4ba2e-0620-4870-b480-bfad22150b6f', 'volume_name': 'volume-6ea4ba2e-0620-4870-b480-bfad22150b6f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7247a3-2204-4e59-aec6-b8c726bd8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7247a3-2204-4e59-aec6-b8c726bd8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68872624-4176-4bc2-a41a-04e1accf8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume 6ea4ba2e-0620-4870-b480-bfad22150b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea4ba2e-0620-4870-b480-bfad22150b6f', 'volume_size': 1}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 1073741824" returned: 0 in 0.702s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb446dba-8e9d-4473-b988-493d02378731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-332056013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef2011c-df3a-49bf-bfea-bd5110ea6c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:11Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0564c34-5d00-446c-be04-04069457ab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0564c34-5d00-446c-be04-04069457ab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822ce91f-2020-4774-ba06-ad34da3a1e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822ce91f-2020-4774-ba06-ad34da3a1e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef2011c-df3a-49bf-bfea-bd5110ea6c6c', 'volume_name': 'volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb2e0f1-45f3-40c0-950b-75fbc7c8c30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb2e0f1-45f3-40c0-950b-75fbc7c8c30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25402d8-7c27-49be-8a2f-97ac6bdb7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:12 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume 2ef2011c-df3a-49bf-bfea-bd5110ea6c6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c', 'volume_size': 1}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:12 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Volume volume-424dac81-65c1-4f12-8297-4af4b6fd36c4 (424dac81-65c1-4f12-8297-4af4b6fd36c4): created successfully
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780bee44-58c2-4666-a5b4-b384b99db1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (2a560c2c-5d6b-455a-be20-fe83393ae3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73" returned: 0 in 0.403s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] <== create_volume: return (1125ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.929s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-358986869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a8fbdc-044f-4a57-a913-c4ed9eaacb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:09Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Creating volume 22a8fbdc-044f-4a57-a913-c4ed9eaacb89 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:12 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:12 devstack quobyte-client[83654]: System call of process 100911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:12 devstack quobyte-client[83654]: System call of process 100911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:12 devstack quobyte-client[83654]: System call of process 100911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:12 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=153, name=volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:12 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2527a248-c636-490d-9788-c67411895af8 tempest-CreateVolumesFromImageTest-712397339 None] Created volume successfully.
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45c116d-8185-49d2-8f1b-f73c4fc07f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:12 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc687c1-ddd0-4123-846a-a3c904d15e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89 1073741824" returned: 0 in 0.404s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:13 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Volume volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 (7fbacd5a-0ed4-4e22-ae33-00cc43e83c73): created successfully
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc687c1-ddd0-4123-846a-a3c904d15e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Flow 'volume_create_manager' (ab074929-dff1-4431-9bf6-c1479ba40c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89" returned: 0 in 0.340s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] <== create_volume: return (771ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.051s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1236819424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4956ad95-e728-40c6-84d8-1065988dc35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c362225fae8640b9b935dd57953482b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:10Z,use_quota=True,user_id='c2d19359e23141bea4e88762ceab89ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Creating volume 4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:13 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:13 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=154, name=volume-4956ad95-e728-40c6-84d8-1065988dc35f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:13 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-72e4bcb6-2035-44a5-b5b0-402ace5b20bf tempest-CreateVolumesFromImageTest-712397339 None] Created volume successfully.
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4267e213-031b-49d3-82ba-2a2e728bde39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598f1a41-4866-40a7-9005-ca72775f933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f 1073741824" returned: 0 in 0.520s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73-delete_volume" acquired by "delete_volume" :: waited 0.282s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:14 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89 (22a8fbdc-044f-4a57-a913-c4ed9eaacb89): created successfully
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598f1a41-4866-40a7-9005-ca72775f933b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (ee050c2c-370c-4d40-b1a8-fbda9c5031fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f" returned: 0 in 0.408s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1061545156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f7b3a0-9db8-40d8-8822-d144ba16a984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:10Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Creating volume a1f7b3a0-9db8-40d8-8822-d144ba16a984 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:14 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:14 devstack quobyte-client[83654]: System call of process 100919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:14 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=155, name=volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:14 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-7ee08913-ac06-4674-933a-006765f959ce tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created volume successfully.
Sep 17 08:14:14 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-quobyte-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34368094-33ca-4ea1-b86a-e54aeec49cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4956ad95-e728-40c6-84d8-1065988dc35f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0798cae4-6d6e-4f20-8495-8c49b03440c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984 1073741824" returned: 0 in 0.538s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73" acquired by "delete_volume" :: waited 0.259s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:15 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Volume volume-4956ad95-e728-40c6-84d8-1065988dc35f (4956ad95-e728-40c6-84d8-1065988dc35f): created successfully
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0798cae4-6d6e-4f20-8495-8c49b03440c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Flow 'volume_create_manager' (69ad7569-6863-45e0-aa32-756ec2ea70b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f66232-6689-491d-9388-c9a2ffbb992d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:15 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-864ee904-3773-44e3-8ca6-2f5bba29ebb8 tempest-CinderUnicodeTest-186075768 None] Created volume successfully.
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984" returned: 0 in 0.652s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] <== create_volume: return (1227ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.558s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1829681716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8a8c6d-83f3-473b-91ab-65c09209f220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:11Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Creating volume 2d8a8c6d-83f3-473b-91ab-65c09209f220 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:15 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:16 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=156, name=volume-2d8a8c6d-83f3-473b-91ab-65c09209f220, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8172bcdc-e7cf-41d3-b10c-b96931cf9c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712998f7-8e30-4a0c-af5a-b485dfae8b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:16 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984 (a1f7b3a0-9db8-40d8-8822-d144ba16a984): created successfully
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712998f7-8e30-4a0c-af5a-b485dfae8b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (d6864439-41ca-4ee7-8d45-f72c2f10e801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73" returned: 0 in 0.999s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220 1073741824" returned: 0 in 0.888s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:16 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3b25d2e5-8daa-49f0-a677-55c1e42710dd tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created volume successfully.
Sep 17 08:14:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73" returned: 0 in 0.607s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:17 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220" returned: 0 in 0.398s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73" released by "delete_volume" :: held 1.959s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] <== create_volume: return (1431ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.039s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1770652923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea4ba2e-0620-4870-b480-bfad22150b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:10Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Creating volume 6ea4ba2e-0620-4870-b480-bfad22150b6f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:17 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:17 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=157, name=volume-6ea4ba2e-0620-4870-b480-bfad22150b6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016dffd6-986a-4a0a-acc5-b2d9eff41791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8a8c6d-83f3-473b-91ab-65c09209f220', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef4f7e0-5316-4cbd-929c-7b9f6699b515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:17 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume volume-2d8a8c6d-83f3-473b-91ab-65c09209f220 (2d8a8c6d-83f3-473b-91ab-65c09209f220): created successfully
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef4f7e0-5316-4cbd-929c-7b9f6699b515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (face64e5-e507-4ce7-8033-af329de89c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f 1073741824" returned: 0 in 0.543s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:18 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d617ed49-a3b0-466c-8373-fbd9908d847c tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created volume successfully.
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f" returned: 0 in 0.421s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] <== create_volume: return (987ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.850s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-332056013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef2011c-df3a-49bf-bfea-bd5110ea6c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac82eb38cc94d83975a98f1b0526340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:11Z,use_quota=True,user_id='5eb67396352d4670a855dc7423ca550f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Creating volume 2ef2011c-df3a-49bf-bfea-bd5110ea6c6c {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:18 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:18 devstack quobyte-client[83654]: System call of process 100936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:18 devstack quobyte-client[83654]: System call of process 100936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=158, name=volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Created reservations ['701a7287-97b6-47f2-9084-5f07a096d86a', 'dd8fea20-50f6-4112-8167-1343e8e5d1f4', 'c1351cbe-1af3-4b19-8429-4ed4ce71d67e', '0ec99f1e-fbf6-4db5-ba5c-037d9efa2472'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68872624-4176-4bc2-a41a-04e1accf8212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea4ba2e-0620-4870-b480-bfad22150b6f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4ae70f-c47c-45a0-a929-37b43567263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c 1073741824" returned: 0 in 0.462s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:19 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume volume-6ea4ba2e-0620-4870-b480-bfad22150b6f (6ea4ba2e-0620-4870-b480-bfad22150b6f): created successfully
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4ae70f-c47c-45a0-a929-37b43567263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (860ac126-0534-407d-9e92-f07c73c62a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c" returned: 0 in 0.465s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] <== create_volume: return (985ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.280s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-36974f60-77b1-43b9-87a6-5c9e1e1f338b tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created volume successfully.
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-424dac81-65c1-4f12-8297-4af4b6fd36c4-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25402d8-7c27-49be-8a2f-97ac6bdb7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516d369d-b4b4-401e-bd7b-fba1c413d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Creating offline snapshot 234864a4-605e-4d37-93b9-f6c3d1cdf096 of volume 4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[372f30c9-dd0b-4998-a9b7-44427ebcec28]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:19 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-424dac81-65c1-4f12-8297-4af4b6fd36c4-delete_volume" acquired by "delete_volume" :: waited 0.333s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:20 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c (2ef2011c-df3a-49bf-bfea-bd5110ea6c6c): created successfully
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516d369d-b4b4-401e-bd7b-fba1c413d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Flow 'volume_create_manager' (b6828045-4096-48ba-bcb8-0601222326c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:20 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-quobyte-424dac81-65c1-4f12-8297-4af4b6fd36c4" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-2d8a8c6d-83f3-473b-91ab-65c09209f220-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:20 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8e4d0976-c47c-465b-b2eb-4403ce21bf66 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created volume successfully.
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f" returned: 0 in 1.093s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.822s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:20 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=159, name=volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:21 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Deleted volume successfully.
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-424dac81-65c1-4f12-8297-4af4b6fd36c4" acquired by "delete_volume" :: waited 0.522s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 1G" returned: 0 in 0.509s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-2d8a8c6d-83f3-473b-91ab-65c09209f220-delete_volume" acquired by "delete_volume" :: waited 0.528s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4956ad95-e728-40c6-84d8-1065988dc35f -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[7805d3a0-f897-448f-afdd-06c3836fef23]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f7ae45c0-be94-4536-8e51-a786f6f8d982 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-7fbacd5a-0ed4-4e22-ae33-00cc43e83c73-delete_volume" released by "delete_volume" :: held 7.836s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:22 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-quobyte-2d8a8c6d-83f3-473b-91ab-65c09209f220" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "qemu-img rebase -u -b volume-4956ad95-e728-40c6-84d8-1065988dc35f -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096" returned: 0 in 0.779s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:22 devstack quobyte-client[83654]: System call of process 100951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4" returned: 0 in 0.709s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096" returned: 0 in 0.246s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-2d8a8c6d-83f3-473b-91ab-65c09209f220" acquired by "delete_volume" :: waited 0.347s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad477fa-b27f-4bfc-89e5-6f49afbb9266]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-424dac81-65c1-4f12-8297-4af4b6fd36c4" returned: 0 in 0.386s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096" returned: 0 in 0.264s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:22 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-424dac81-65c1-4f12-8297-4af4b6fd36c4" released by "delete_volume" :: held 1.652s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.info" returned: 0 in 0.388s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.info" returned: 0 in 0.253s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220" returned: 0 in 0.839s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.075s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2d8a8c6d-83f3-473b-91ab-65c09209f220" returned: 0 in 0.380s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:23 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-a2f46e91-5dbe-45e9-bfca-e6d28f5cc4df tempest-CinderUnicodeTest-186075768 None] Create snapshot completed successfully
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-2d8a8c6d-83f3-473b-91ab-65c09209f220" released by "delete_volume" :: held 1.548s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:23 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Created reservations ['dc3b9b00-c9cb-4a3d-9bfb-fd2481c13fcc', '5fa8aa0d-2745-484b-9d85-5e07c57f4723', '7a178b12-fc5e-4539-b050-66e6355d06d8', 'aea15f58-1ea7-4e09-aa8c-e805f723ac5a'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created reservations ['8ba0d6b9-d8ef-4c3b-a378-aac44187db01', '61d11f11-8d9a-4381-be29-846c13773971', '77299667-aedb-4e70-812e-4f667469af6d', 'd273456b-89e3-4bc3-87e4-1526fd8e906b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.379s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:24 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Deleted volume successfully.
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-234864a4-605e-4d37-93b9-f6c3d1cdf096-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.422s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:24 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Deleted volume successfully.
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-234864a4-605e-4d37-93b9-f6c3d1cdf096-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-quobyte-4956ad95-e728-40c6-84d8-1065988dc35f" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-b0d9313d-eb29-4bc6-8b38-564a5130c921 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-424dac81-65c1-4f12-8297-4af4b6fd36c4-delete_volume" released by "delete_volume" :: held 5.024s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-4956ad95-e728-40c6-84d8-1065988dc35f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-quobyte-234864a4-605e-4d37-93b9-f6c3d1cdf096" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-234864a4-605e-4d37-93b9-f6c3d1cdf096" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Deleting offline snapshot 234864a4-605e-4d37-93b9-f6c3d1cdf096 of volume 4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] snapshot_file for this snap is: volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-1f7fb724-9fa0-4296-ab1c-9b3a6b949942 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-2d8a8c6d-83f3-473b-91ab-65c09209f220-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1a801-3122-42cc-b064-d8cee824a613]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096" returned: 0 in 0.577s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4956ad95-e728-40c6-84d8-1065988dc35f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8bbed-8929-4629-9907-25017830629f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-quobyte-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-quobyte-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4" acquired by "delete_volume" :: waited 0.531s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c" acquired by "delete_volume" :: waited 0.068s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c45f06-11ab-4994-b530-7596edc87a4a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe133a6-5824-43ab-bd21-3de34d2e2af1]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f" returned: 0 in 1.052s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:27 devstack quobyte-client[83654]: System call of process 100977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:27 devstack quobyte-client[83654]: System call of process 101002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:27 devstack quobyte-client[83654]: System call of process 100978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4" returned: 0 in 1.035s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c" returned: 0 in 1.181s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096" returned: 0 in 0.783s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4" returned: 0 in 0.478s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c" returned: 0 in 0.358s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f.234864a4-605e-4d37-93b9-f6c3d1cdf096" returned: 0 in 0.229s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4" released by "delete_volume" :: held 1.782s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c" released by "delete_volume" :: held 1.889s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-234864a4-605e-4d37-93b9-f6c3d1cdf096" released by "_delete_snapshot" :: held 3.214s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-4956ad95-e728-40c6-84d8-1065988dc35f" released by "delete_snapshot" :: held 3.251s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created reservations ['36a59f63-0e0a-4413-bbd9-5bf23ce45a69', '6cebce99-2e62-4e34-83bd-68caaed868d2', 'e9f94b45-e611-40ee-b3bc-6bdb530c7236', '309a1b45-afc8-46b5-9cae-56f2a31386c0'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Created reservations ['03cf1462-6d0f-4cb5-aa91-e894d0a47935', '122284cd-13d5-498c-98a5-91a431b93d38', 'cb29ae9f-3529-417d-99f6-23c5b5dc723d', '968b0879-4498-4a91-b467-f44dac8746c9'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-6ea4ba2e-0620-4870-b480-bfad22150b6f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Created reservations ['d5b9b880-ba5a-4182-a243-4a643eb0e76c', '9732a3ad-fa49-4d17-b7e1-9f221ecb58c3', 'f0ad1b17-09b5-4fbc-be43-7a0ca3d8346a', '9a5d80ce-7e79-4e8b-8614-f1d829411324'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.428s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:28 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-6ea4ba2e-0620-4870-b480-bfad22150b6f-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:28 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Deleted volume successfully.
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-908e5fc6-1a69-4d21-9464-df8c85f2ae36 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-2ef2011c-df3a-49bf-bfea-bd5110ea6c6c-delete_volume" released by "delete_volume" :: held 3.908s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.434s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:29 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-quobyte-6ea4ba2e-0620-4870-b480-bfad22150b6f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Deleted volume successfully.
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-6ea4ba2e-0620-4870-b480-bfad22150b6f" acquired by "delete_volume" :: waited 0.051s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Delete snapshot completed successfully.
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d20a21c-af9e-4e78-89e8-a5ca5986ac54]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-07c513fc-1292-4f81-860b-d3eb7a7b3bf4 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-234864a4-605e-4d37-93b9-f6c3d1cdf096-delete_snapshot" released by "delete_snapshot" :: held 4.944s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-52ad86ce-545a-4b97-af19-14881ba318e2 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-0fc7a41a-7b55-4d75-bd6e-05953a5d80a4-delete_volume" released by "delete_volume" :: held 4.492s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-1b010cba-ec85-4cc3-899a-3679d0d79ab7-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-4956ad95-e728-40c6-84d8-1065988dc35f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:29 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-1b010cba-ec85-4cc3-899a-3679d0d79ab7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-4956ad95-e728-40c6-84d8-1065988dc35f-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-quobyte-1b010cba-ec85-4cc3-899a-3679d0d79ab7" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:30 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-quobyte-4956ad95-e728-40c6-84d8-1065988dc35f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f" returned: 0 in 0.693s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-1b010cba-ec85-4cc3-899a-3679d0d79ab7" acquired by "delete_volume" :: waited 0.175s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ae7e06-875f-40c8-8742-880a0d661913]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-4956ad95-e728-40c6-84d8-1065988dc35f" acquired by "delete_volume" :: waited 0.380s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[272a02a5-efbb-4db8-9982-12e383824ded]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-6ea4ba2e-0620-4870-b480-bfad22150b6f" returned: 0 in 0.514s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-6ea4ba2e-0620-4870-b480-bfad22150b6f" released by "delete_volume" :: held 1.434s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7" returned: 0 in 0.694s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-1b010cba-ec85-4cc3-899a-3679d0d79ab7" returned: 0 in 0.331s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f" returned: 0 in 0.882s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-1b010cba-ec85-4cc3-899a-3679d0d79ab7" released by "delete_volume" :: held 1.331s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:31 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created reservations ['ee06a806-60e6-4ca0-9217-94ce2e901f6e', '75b5602b-135c-430f-a567-09951c1a18eb', '54f0bf7a-6997-4ea7-a563-edd2020b591a', '933aeae7-33d9-4114-81db-0d4e2c22ed96'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-4956ad95-e728-40c6-84d8-1065988dc35f" returned: 0 in 0.402s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-4956ad95-e728-40c6-84d8-1065988dc35f" released by "delete_volume" :: held 1.457s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Created reservations ['7abb511e-c0d4-4663-90f7-8b37d1bb927d', '5f27a037-90e2-490a-874a-2167f4ad12e3', '2632be18-66bc-4e69-993d-1260c6a562cf', '322494ac-1bc1-4afd-9bf7-5f60fc0facd4'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.190s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:32 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Deleted volume successfully.
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Created reservations ['9746b21d-8363-419a-abef-2cfddf013428', '280e61b2-340d-4b14-adcb-4b775bf7927d', '54f3e6ab-b46b-42d1-93c1-9c8b768f900d', '16f122c7-0c8f-4b19-b7aa-846360d4d0ff'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-ce5002f8-8d20-4602-844f-a073a410ca0d tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-6ea4ba2e-0620-4870-b480-bfad22150b6f-delete_volume" released by "delete_volume" :: held 3.816s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:32 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-b21a5f94-be41-4eb6-8a29-589472ae04f7-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-a1f7b3a0-9db8-40d8-8822-d144ba16a984-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.482s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:33 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Deleted volume successfully.
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-a1f7b3a0-9db8-40d8-8822-d144ba16a984-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-b21a5f94-be41-4eb6-8a29-589472ae04f7-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-d7755a91-50b2-49bb-890c-b2caf8dd2fc2-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-69f04640-e915-4455-b3d0-70ea0a22d7cf tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-1b010cba-ec85-4cc3-899a-3679d0d79ab7-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "cinder-quobyte-b21a5f94-be41-4eb6-8a29-589472ae04f7" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.416s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:33 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Deleted volume successfully.
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Lock "cinder-d7755a91-50b2-49bb-890c-b2caf8dd2fc2-delete_volume" acquired by "delete_volume" :: waited 0.484s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:33 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-quobyte-a1f7b3a0-9db8-40d8-8822-d144ba16a984" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:33 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-b21a5f94-be41-4eb6-8a29-589472ae04f7" acquired by "delete_volume" :: waited 0.132s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-a1f7b3a0-9db8-40d8-8822-d144ba16a984" acquired by "delete_volume" :: waited 0.038s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a4c79f-6180-4b27-a863-e7fb697c0f7a]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:34 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Acquiring lock "cinder-quobyte-d7755a91-50b2-49bb-890c-b2caf8dd2fc2" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[17558fa8-13a7-485f-9acf-f5b55c061cf2]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3235efc3-7e31-40f0-b91e-faf1a0e651b8 tempest-CinderUnicodeTest-186075768 None] Lock "cinder-4956ad95-e728-40c6-84d8-1065988dc35f-delete_volume" released by "delete_volume" :: held 4.098s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-d7755a91-50b2-49bb-890c-b2caf8dd2fc2" acquired by "delete_volume" :: waited 0.510s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7" returned: 0 in 0.630s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d260896c-4898-4c5d-a2df-c31d71374ddb]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:34 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-b21a5f94-be41-4eb6-8a29-589472ae04f7" returned: 0 in 0.249s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984" returned: 0 in 0.741s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-quobyte-b21a5f94-be41-4eb6-8a29-589472ae04f7" released by "delete_volume" :: held 1.188s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-a1f7b3a0-9db8-40d8-8822-d144ba16a984" returned: 0 in 0.409s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2" returned: 0 in 0.659s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-a1f7b3a0-9db8-40d8-8822-d144ba16a984" released by "delete_volume" :: held 1.645s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-d7755a91-50b2-49bb-890c-b2caf8dd2fc2" returned: 0 in 0.401s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Created reservations ['e57bbe2c-2dd4-4526-ad83-d9a1bbc08520', 'e609cf05-7b1a-435f-a850-b7ffd20737d1', '2a269983-9d1d-46d0-acc5-378cad5dc1d5', '8504cb59-6f21-4969-a11e-8baea91ff9d6'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:35 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Lock "cinder-quobyte-d7755a91-50b2-49bb-890c-b2caf8dd2fc2" released by "delete_volume" :: held 1.442s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created reservations ['6cceae0e-1fcd-49cd-82a2-d9de710c9c6a', 'cff461e1-7f34-441a-9b2a-6c6d9242334e', '77b7719b-9fd8-4f2b-a931-0b6f21202843', 'aae3f8a6-2769-4f57-b117-70c2124ba84b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Created reservations ['13d5c0a6-8dd9-4ec4-a42a-e6c082fcbe8b', 'd6ea8083-8633-4645-a3d7-b603daa33607', '9f81d170-969c-499e-80a9-9ab899cf26e3', '2c5839e9-b2ed-4e06-bba8-aee95bf60e73'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.595s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-22a8fbdc-044f-4a57-a913-c4ed9eaacb89-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Deleted volume successfully.
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.523s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-22a8fbdc-044f-4a57-a913-c4ed9eaacb89-delete_volume" acquired by "delete_volume" :: waited 0.206s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Deleted volume successfully.
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e03f26df-46af-4af4-8997-bd453ab80d18 tempest-CreateVolumesFromImageTest-712397339 None] Lock "cinder-b21a5f94-be41-4eb6-8a29-589472ae04f7-delete_volume" released by "delete_volume" :: held 3.782s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-8141af3c-01fd-4542-864c-114a41f35889 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-a1f7b3a0-9db8-40d8-8822-d144ba16a984-delete_volume" released by "delete_volume" :: held 4.341s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:37 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-quobyte-22a8fbdc-044f-4a57-a913-c4ed9eaacb89" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.594s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:37 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Deleted volume successfully.
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-22a8fbdc-044f-4a57-a913-c4ed9eaacb89" acquired by "delete_volume" :: waited 0.080s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-319caf1a-d40a-40d4-b912-f016b2cb6c0a tempest-CinderUnicodeTest-186075768 None] Lock "cinder-d7755a91-50b2-49bb-890c-b2caf8dd2fc2-delete_volume" released by "delete_volume" :: held 3.991s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[36917bdb-b22f-4a26-abb7-3f4ea98599f8]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89" returned: 0 in 0.590s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-22a8fbdc-044f-4a57-a913-c4ed9eaacb89" returned: 0 in 0.135s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-22a8fbdc-044f-4a57-a913-c4ed9eaacb89" released by "delete_volume" :: held 0.963s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created reservations ['fd413e51-20b5-4c68-9654-7ba86f365c5f', 'e70706d0-f4c2-4754-ad36-b7f75f8c44b7', '329c9191-ddde-4838-a6f9-12abe7ce25aa', '8fd3609c-2763-4488-93f7-47af7c05e3e5'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.103s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:39 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Deleted volume successfully.
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-f1829cc8-7942-41f7-b53e-700f1fd35679 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-22a8fbdc-044f-4a57-a913-c4ed9eaacb89-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-c68d96f4-3540-4eb0-b465-64b993ce2e29-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-c68d96f4-3540-4eb0-b465-64b993ce2e29-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:40 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "cinder-quobyte-c68d96f4-3540-4eb0-b465-64b993ce2e29" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-c68d96f4-3540-4eb0-b465-64b993ce2e29" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9f6e8-4058-4c52-a20a-ab7145f5d3b6]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29" returned: 0 in 0.539s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-c68d96f4-3540-4eb0-b465-64b993ce2e29" returned: 0 in 0.165s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-quobyte-c68d96f4-3540-4eb0-b465-64b993ce2e29" released by "delete_volume" :: held 1.156s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:41 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (0960042f-e428-4eae-9fcc-9953f785148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:41 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866afa55-5ebc-4a2f-863a-76866b3cfab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866afa55-5ebc-4a2f-863a-76866b3cfab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312127382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140ca92a-207f-453a-97cc-bd05c4d2ddad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:41Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac3e5fb-c80b-42bc-8462-22d6bc06b85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac3e5fb-c80b-42bc-8462-22d6bc06b85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994681bd-5ce2-40db-b612-da1e98ce1839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994681bd-5ce2-40db-b612-da1e98ce1839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140ca92a-207f-453a-97cc-bd05c4d2ddad', 'volume_name': 'volume-140ca92a-207f-453a-97cc-bd05c4d2ddad', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de39212-2d72-44d0-b530-a9c4d0d58f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de39212-2d72-44d0-b530-a9c4d0d58f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4830881f-2d57-427c-9bd4-ce647f906d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:42 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume 140ca92a-207f-453a-97cc-bd05c4d2ddad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140ca92a-207f-453a-97cc-bd05c4d2ddad', 'volume_size': 1}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1312127382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140ca92a-207f-453a-97cc-bd05c4d2ddad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:41Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating volume 140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:42 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:42 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=161, name=volume-140ca92a-207f-453a-97cc-bd05c4d2ddad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Created reservations ['c179a7c5-321e-4132-8f8d-bfd6c016670b', 'd4190949-df38-4c65-8da6-741ecaec485c', 'c5944c5d-4788-41fe-82aa-b161c6a0bcc2', '5d75153a-39e3-4548-81ad-086267ac92a5'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad 1073741824" returned: 0 in 0.490s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad" returned: 0 in 0.278s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] <== create_volume: return (815ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4830881f-2d57-427c-9bd4-ce647f906d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140ca92a-207f-453a-97cc-bd05c4d2ddad', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366e729-293a-4432-bb4b-91b3a79a49d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:43 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume volume-140ca92a-207f-453a-97cc-bd05c4d2ddad (140ca92a-207f-453a-97cc-bd05c4d2ddad): created successfully
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d366e729-293a-4432-bb4b-91b3a79a49d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (0960042f-e428-4eae-9fcc-9953f785148b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9e933f0d-6c98-43b9-9d8b-24dcff6e527f tempest-CreateVolumesFromSnapshotTest-436699438 None] Created volume successfully.
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.214s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Deleted volume successfully.
Sep 17 08:14:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-2e886ead-4a9c-4939-ba12-e540858ea885 tempest-CreateVolumesFromSourceVolumeTest-1896149584 None] Lock "cinder-c68d96f4-3540-4eb0-b465-64b993ce2e29-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:14:44 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating offline snapshot 2ee3f222-5975-45a8-b738-7a60aebf8dc5 of volume 140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5208c86c-6289-480f-8eed-9974113c149f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad" returned: 0 in 0.525s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:44 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:45 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=162, name=volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 1G" returned: 0 in 0.344s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img rebase -u -b volume-140ca92a-207f-453a-97cc-bd05c4d2ddad -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:45 devstack quobyte-client[83654]: System call of process 101078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img rebase -u -b volume-140ca92a-207f-453a-97cc-bd05c4d2ddad -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5" returned: 0 in 0.221s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5" returned: 0 in 0.122s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5" returned: 0 in 0.123s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:45 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.info" returned: 0 in 0.156s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.info" returned: 0 in 0.197s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:46 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-52caefe3-e592-4b97-84bb-48d72f506e7c tempest-CreateVolumesFromSnapshotTest-436699438 None] Create snapshot completed successfully
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.131s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:14:48 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (07efa108-e472-4d79-a423-23e09ea3642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc869bf-4413-42e4-8a34-a21fabb1d8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc869bf-4413-42e4-8a34-a21fabb1d8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220663932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cccb14df-df70-4347-a3ad-c8fb3d9384ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:48Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6f693a-3f66-4c25-bf80-1379d1c70085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6f693a-3f66-4c25-bf80-1379d1c70085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cf8f55-18ce-4e9b-9d48-f99f3d1dbf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cf8f55-18ce-4e9b-9d48-f99f3d1dbf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cccb14df-df70-4347-a3ad-c8fb3d9384ec', 'volume_name': 'volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb7af0-13c6-4d67-bbbc-7389121eabec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb7af0-13c6-4d67-bbbc-7389121eabec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7c5f81-e131-44a1-b0e1-afcfc5a1f48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:48 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume cccb14df-df70-4347-a3ad-c8fb3d9384ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec', 'volume_size': 1}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1220663932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cccb14df-df70-4347-a3ad-c8fb3d9384ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:48Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating volume cccb14df-df70-4347-a3ad-c8fb3d9384ec {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:48 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:48 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:48 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=164, name=volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (4af76ec0-eb27-413e-9a94-9ab38ac1195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a62396-792a-4f35-bf7d-7fbe422be121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec 1073741824" returned: 0 in 1.647s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (4498112c-283b-4699-8ead-a733facfefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccfe41b-1ad4-49ba-85f4-2faa4c38802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (e4f08059-78e6-4101-bcb8-a557af3fb39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6f087b-b2a4-476e-a111-67b4b2d0df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a62396-792a-4f35-bf7d-7fbe422be121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640804002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ea25e3-4f13-46b9-b0c4-baae929f4942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:48Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d34f1-fe98-478c-a18a-53ded7b5ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d34f1-fe98-478c-a18a-53ded7b5ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117fd5bb-cec1-48b1-87ca-623e4069dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117fd5bb-cec1-48b1-87ca-623e4069dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ea25e3-4f13-46b9-b0c4-baae929f4942', 'volume_name': 'volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bf1d12-ddf4-4de2-a14a-ac8fc122d704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bf1d12-ddf4-4de2-a14a-ac8fc122d704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc97b19-fc75-47a4-bf7d-4ff37cea02d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:50 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume e9ea25e3-4f13-46b9-b0c4-baae929f4942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942', 'volume_size': 1}
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:50 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:50 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (58f99ffd-abe6-44f0-b218-d9fd82d2bbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee5495b-2b41-45dc-b603-4a869d0bd3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccfe41b-1ad4-49ba-85f4-2faa4c38802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-790091121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3ad37f-9282-483b-95e5-988284677b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:49Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebcebf9-63b4-4ad6-b913-09eb1bfda631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebcebf9-63b4-4ad6-b913-09eb1bfda631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5b50e5-c26e-4e48-bb2d-20930e8d6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5b50e5-c26e-4e48-bb2d-20930e8d6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3ad37f-9282-483b-95e5-988284677b72', 'volume_name': 'volume-8e3ad37f-9282-483b-95e5-988284677b72', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b831ec6d-9c52-4fa9-8f15-5dc024e06645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b831ec6d-9c52-4fa9-8f15-5dc024e06645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043ed099-25d9-40ca-949b-5a88390bbf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume 8e3ad37f-9282-483b-95e5-988284677b72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3ad37f-9282-483b-95e5-988284677b72', 'volume_size': 1}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6f087b-b2a4-476e-a111-67b4b2d0df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571617535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032d0e38-59e3-4ac7-b7ac-074567cd4a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:50Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff4b22a-3e80-4466-a60c-cd0719610fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff4b22a-3e80-4466-a60c-cd0719610fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437facf6-12fb-4a20-9390-6d87248ffaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437facf6-12fb-4a20-9390-6d87248ffaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032d0e38-59e3-4ac7-b7ac-074567cd4a9a', 'volume_name': 'volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0864e8e5-9939-4428-a22f-fa6f964c62d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0864e8e5-9939-4428-a22f-fa6f964c62d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f61e0b-691c-4255-81f2-e3036810f412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume 032d0e38-59e3-4ac7-b7ac-074567cd4a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a', 'volume_size': 1}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec" returned: 0 in 1.025s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] <== create_volume: return (2737ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.762s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640804002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ea25e3-4f13-46b9-b0c4-baae929f4942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:48Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating volume e9ea25e3-4f13-46b9-b0c4-baae929f4942 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:51 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:51 devstack quobyte-client[83654]: System call of process 101091 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:51 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=165, name=volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee5495b-2b41-45dc-b603-4a869d0bd3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1503015132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413d66c0-a56c-4616-8a1f-193adf3b0574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:50Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc576b3-e941-4a2a-a8e5-ee5947c9489a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc576b3-e941-4a2a-a8e5-ee5947c9489a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede78b4c-0316-45e5-98ce-e34411dfd0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:51 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede78b4c-0316-45e5-98ce-e34411dfd0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413d66c0-a56c-4616-8a1f-193adf3b0574', 'volume_name': 'volume-413d66c0-a56c-4616-8a1f-193adf3b0574', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd864548-ba9c-466a-ad1d-16b4d76711c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd864548-ba9c-466a-ad1d-16b4d76711c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d2e880-5d92-4869-8075-5a87a9f20c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:52 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume 413d66c0-a56c-4616-8a1f-193adf3b0574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413d66c0-a56c-4616-8a1f-193adf3b0574', 'volume_size': 1}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7c5f81-e131-44a1-b0e1-afcfc5a1f48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2854be-0cad-415c-86ed-9d253285afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942 1073741824" returned: 0 in 1.385s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:52 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:53 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Flow 'volume_create_manager' (e873db9b-82a7-4842-ab24-2f3505faeed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79cd6a6-abbd-4d50-8dfa-81fcc6e4db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:53 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec (cccb14df-df70-4347-a3ad-c8fb3d9384ec): created successfully
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2854be-0cad-415c-86ed-9d253285afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (07efa108-e472-4d79-a423-23e09ea3642d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942" returned: 0 in 0.963s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:53 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-53223641-cbfe-4e1b-9128-33a2e3239cb4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created volume successfully.
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] <== create_volume: return (2430ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.439s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79cd6a6-abbd-4d50-8dfa-81fcc6e4db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb7b8ed-4934-4eac-8707-c5906a5521a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b0edccba2b4468a68c178cd7ef9f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:52Z,use_quota=True,user_id='c0f5f49d957246acaed996407473fd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b63e1-87e9-4699-8a33-964ce1a74f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b63e1-87e9-4699-8a33-964ce1a74f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93403f7-380a-47f8-a417-d14525dae252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.666s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-790091121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3ad37f-9282-483b-95e5-988284677b72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:49Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating volume 8e3ad37f-9282-483b-95e5-988284677b72 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:53 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:53 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:54 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=166, name=volume-8e3ad37f-9282-483b-95e5-988284677b72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc97b19-fc75-47a4-bf7d-4ff37cea02d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:54 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7b618-b2f8-4227-9ed0-4b88631545e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72 1073741824" returned: 0 in 0.823s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:54 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:55 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942 (e9ea25e3-4f13-46b9-b0c4-baae929f4942): created successfully
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7b618-b2f8-4227-9ed0-4b88631545e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (4af76ec0-eb27-413e-9a94-9ab38ac1195b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=152,cinder:SELECT=91,cinder:DELETE=12,cinder:INSERT=27 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72" returned: 0 in 0.789s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] <== create_volume: return (1669ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93403f7-380a-47f8-a417-d14525dae252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0fb7b8ed-4934-4eac-8707-c5906a5521a4', 'volume_name': 'volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4', 'volume_size': 1, 'image_id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46481b8c3e19db93c94016c3bc5cd810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05b0edccba2b4468a68c178cd7ef9f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b465e689ae48ceba5b044490c3acd30017022440f06eee12704c3db6d7793c7305de2a83e363a30273e338bf8548a36ef9a9b74f114bb627199a8ef376ea622', 'id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'created_at': datetime.datetime(2025, 9, 17, 6, 14, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc367a05-b4a3-4c44-8a0b-393abbd9fded/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c8607e5c0>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87df0c7b-d961-49a8-be0c-3ae9b3880175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87df0c7b-d961-49a8-be0c-3ae9b3880175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb3a55c-b65a-4d93-aa85-31292f81b558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:55 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Volume 0fb7b8ed-4934-4eac-8707-c5906a5521a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4', 'volume_size': 1, 'image_id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46481b8c3e19db93c94016c3bc5cd810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05b0edccba2b4468a68c178cd7ef9f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b465e689ae48ceba5b044490c3acd30017022440f06eee12704c3db6d7793c7305de2a83e363a30273e338bf8548a36ef9a9b74f114bb627199a8ef376ea622', 'id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'created_at': datetime.datetime(2025, 9, 17, 6, 14, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc367a05-b4a3-4c44-8a0b-393abbd9fded/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c8607e5c0>}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Cloning 0fb7b8ed-4934-4eac-8707-c5906a5521a4 from image dc367a05-b4a3-4c44-8a0b-393abbd9fded  at location (None, None). {{(pid=83645) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.373s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571617535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032d0e38-59e3-4ac7-b7ac-074567cd4a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:50Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating volume 032d0e38-59e3-4ac7-b7ac-074567cd4a9a {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:55 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:SELECT=94,cinder:UPDATE=140,cinder:DELETE=18,cinder:INSERT=29 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:14:56 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=167, name=volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:56 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0a31af78-6a6e-4b3b-9de4-ad595ef3cca7 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created volume successfully.
Sep 17 08:14:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043ed099-25d9-40ca-949b-5a88390bbf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3ad37f-9282-483b-95e5-988284677b72', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7babcf25-5e1f-4e7a-8cf3-c7a9e0e7c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a 1073741824" returned: 0 in 0.855s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:56 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:56 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume volume-8e3ad37f-9282-483b-95e5-988284677b72 (8e3ad37f-9282-483b-95e5-988284677b72): created successfully
Sep 17 08:14:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7babcf25-5e1f-4e7a-8cf3-c7a9e0e7c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:56 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (4498112c-283b-4699-8ead-a733facfefe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD, size 0.00 MB, duration 1.44 sec {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 17 08:14:57 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Image download 0.00 MB at 0.00 MB/s
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a" returned: 0 in 0.589s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] <== create_volume: return (1473ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.123s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1503015132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413d66c0-a56c-4616-8a1f-193adf3b0574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9267c83d98d24ec9b79fd372e85df77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:50Z,use_quota=True,user_id='4f318e7c937b413e9785b43ca12cc217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Creating volume 413d66c0-a56c-4616-8a1f-193adf3b0574 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:14:57 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:57 devstack quobyte-client[83654]: System call of process 101104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:14:57 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=168, name=volume-413d66c0-a56c-4616-8a1f-193adf3b0574, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:14:57 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6daa48f0-420e-4abc-a2a5-c55624febfba tempest-CreateVolumesFromSnapshotTest-436699438 None] Created volume successfully.
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a2039f-a314-47b6-8be9-c9072e4098e1]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f61e0b-691c-4255-81f2-e3036810f412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:57 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28f3eac-80f0-451e-85b6-d68156950da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574 1073741824" returned: 0 in 1.116s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:14:58 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD
Sep 17 08:14:58 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:14:58 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a (032d0e38-59e3-4ac7-b7ac-074567cd4a9a): created successfully
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28f3eac-80f0-451e-85b6-d68156950da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (e4f08059-78e6-4101-bcb8-a557af3fb39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574" returned: 0 in 0.547s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] <== create_volume: return (1702ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:14:58 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3d22c749-a420-45f5-ad80-258f2dcce795 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created volume successfully.
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d2e880-5d92-4869-8075-5a87a9f20c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413d66c0-a56c-4616-8a1f-193adf3b0574', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c23972c-862c-4b3a-8d62-30884de6074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:14:58 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume volume-413d66c0-a56c-4616-8a1f-193adf3b0574 (413d66c0-a56c-4616-8a1f-193adf3b0574): created successfully
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c23972c-862c-4b3a-8d62-30884de6074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:14:58 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Flow 'volume_create_manager' (58f99ffd-abe6-44f0-b218-d9fd82d2bbf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:14:59 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-091dd11a-64b8-4664-8400-faf2d45df9ac tempest-CreateVolumesFromSnapshotTest-436699438 None] Created volume successfully.
Sep 17 08:14:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-413d66c0-a56c-4616-8a1f-193adf3b0574-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:14:59 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-413d66c0-a56c-4616-8a1f-193adf3b0574-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:00 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-413d66c0-a56c-4616-8a1f-193adf3b0574" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:00 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-413d66c0-a56c-4616-8a1f-193adf3b0574" acquired by "delete_volume" :: waited 0.039s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:00 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad981a3-dc00-4343-b35a-63edd1cd3c51]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:00 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Sep 17 08:15:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD" returned: 0 in 3.257s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:00 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574" returned: 0 in 0.843s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-413d66c0-a56c-4616-8a1f-193adf3b0574" returned: 0 in 0.179s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-413d66c0-a56c-4616-8a1f-193adf3b0574" released by "delete_volume" :: held 1.250s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:01 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD
Sep 17 08:15:01 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['3df60fa9-3230-4308-9d71-b6273ec962c2', 'c5e283ca-503d-4802-bcb6-1f3af0f93f95', '9d692ad5-0087-448a-a15a-afcabed09177', '0ffb2991-851e-4ac7-b0ab-c9454ca9d4a9'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:01 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.159s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:02 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleted volume successfully.
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-032d0e38-59e3-4ac7-b7ac-074567cd4a9a-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-19663387-ee53-4921-9f16-a2d8ec8facd4 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-413d66c0-a56c-4616-8a1f-193adf3b0574-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-032d0e38-59e3-4ac7-b7ac-074567cd4a9a-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:02 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-032d0e38-59e3-4ac7-b7ac-074567cd4a9a" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-032d0e38-59e3-4ac7-b7ac-074567cd4a9a" acquired by "delete_volume" :: waited 0.013s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd44b7-8ad3-4880-b5ae-dde8b30e00c9]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:02 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a" returned: 0 in 0.648s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:03 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-032d0e38-59e3-4ac7-b7ac-074567cd4a9a" returned: 0 in 0.224s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-032d0e38-59e3-4ac7-b7ac-074567cd4a9a" released by "delete_volume" :: held 1.225s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:04 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD" returned: 1 in 3.438s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Temporary image dc367a05-b4a3-4c44-8a0b-393abbd9fded is fetched for user c0f5f49d957246acaed996407473fd5c. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['b7ab9f08-e005-4e3b-bed9-e978219156de', 'af5c3167-1ed5-40ec-9797-9b3eef6324e4', '0f3bcac2-e472-4d19-b1df-4a87572ab7be', '159ddf7b-99b6-4b45-8fed-443a8a436f19'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:04 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-8e3ad37f-9282-483b-95e5-988284677b72-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c0fee-669f-4a3a-a409-fb7b5dc80059]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.642s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-8e3ad37f-9282-483b-95e5-988284677b72-delete_volume" acquired by "delete_volume" :: waited 0.406s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:05 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleted volume successfully.
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3abf9493-462e-4c7e-a72d-86ae21274f7b tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-032d0e38-59e3-4ac7-b7ac-074567cd4a9a-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:05 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD
Sep 17 08:15:05 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:05 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-8e3ad37f-9282-483b-95e5-988284677b72" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-8e3ad37f-9282-483b-95e5-988284677b72" acquired by "delete_volume" :: waited 0.027s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:05 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff86572-990e-4de3-ae11-ec13fb76017e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72" returned: 0 in 0.596s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:06 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-8e3ad37f-9282-483b-95e5-988284677b72" returned: 0 in 0.155s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:07 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-8e3ad37f-9282-483b-95e5-988284677b72" released by "delete_volume" :: held 1.085s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:07 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['8ff8379f-03e0-4de1-a1da-fb3a80841ec2', '56663c38-7d1b-4bcb-88a0-140690615952', '6f306dc6-fb93-458d-ba35-deded226708c', 'ce5e437c-4736-4c3f-9cc4-c004ea8cb84b'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-e9ea25e3-4f13-46b9-b0c4-baae929f4942-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:08 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.805s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:08 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-e9ea25e3-4f13-46b9-b0c4-baae929f4942-delete_volume" acquired by "delete_volume" :: waited 0.312s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:09 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleted volume successfully.
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD" returned: 0 in 3.879s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-3aaceca7-3d90-426a-9050-61a4ed629325 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-8e3ad37f-9282-483b-95e5-988284677b72-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:09 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-e9ea25e3-4f13-46b9-b0c4-baae929f4942" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-e9ea25e3-4f13-46b9-b0c4-baae929f4942" acquired by "delete_volume" :: waited 0.023s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3878f130-fc5a-470a-b776-7c11e27258a4]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:09 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:09 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD
Sep 17 08:15:09 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 17 08:15:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942" returned: 0 in 0.690s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:10 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-e9ea25e3-4f13-46b9-b0c4-baae929f4942" returned: 0 in 0.201s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:10 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-e9ea25e3-4f13-46b9-b0c4-baae929f4942" released by "delete_volume" :: held 1.111s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['315bb5f8-7704-4dc6-b3f2-986f7a7adfa8', '9f4f52a3-dbdb-405c-b9f3-0699950add5c', '6f6b2da2-dd0c-400d-abf3-f12c5fd3742f', 'b3a56455-7e18-4c0c-82a2-d86386b27a85'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.155s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:11 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:11 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleted volume successfully.
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-cccb14df-df70-4347-a3ad-c8fb3d9384ec-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-cccb14df-df70-4347-a3ad-c8fb3d9384ec-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-9ab0e93d-d3bd-44e8-b3b5-61e6a68a8d61 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-e9ea25e3-4f13-46b9-b0c4-baae929f4942-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:12 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Sep 17 08:15:12 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-cccb14df-df70-4347-a3ad-c8fb3d9384ec" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD" returned: 1 in 3.625s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb7b8ed-4934-4eac-8707-c5906a5521a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05b0edccba2b4468a68c178cd7ef9f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:14:52Z,use_quota=True,user_id='c0f5f49d957246acaed996407473fd5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Creating volume 0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:15:12 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:15:12 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:12 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=169, name=volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-cccb14df-df70-4347-a3ad-c8fb3d9384ec" acquired by "delete_volume" :: waited 0.403s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 1073741824" returned: 0 in 0.444s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615f6c1-00fe-463a-b26e-4fbf3ed5909d]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 0 in 0.305s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] <== create_volume: return (811ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:13 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Attempting download of dc367a05-b4a3-4c44-8a0b-393abbd9fded ((None, None)) to volume 0fb7b8ed-4934-4eac-8707-c5906a5521a4. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[46356392-3be8-47b5-a585-841b431592b9]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc367a05-b4a3-4c44-8a0b-393abbd9fded_rrb5ltfb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec" returned: 0 in 0.913s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-cccb14df-df70-4347-a3ad-c8fb3d9384ec" returned: 0 in 0.182s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-cccb14df-df70-4347-a3ad-c8fb3d9384ec" released by "delete_volume" :: held 1.544s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc367a05-b4a3-4c44-8a0b-393abbd9fded_rrb5ltfb" returned: 0 in 0.695s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:14 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc367a05-b4a3-4c44-8a0b-393abbd9fded_rrb5ltfb {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:15 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['942910f0-2be8-4f11-94e2-c290e4cc7e48', '3e21f512-a3e5-43e3-b5d3-490aa1bf1c68', '00e5f91e-1a3a-48e9-bf8c-ce99d7433c2e', 'd44510b1-1a92-4a66-b0f4-6ad7cb8658f4'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc367a05-b4a3-4c44-8a0b-393abbd9fded_rrb5ltfb" returned: 1 in 0.623s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc367a05-b4a3-4c44-8a0b-393abbd9fded_rrb5ltfb' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:15:15 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3edb4-7707-4e39-81e2-757c2f462271]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:15 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:15 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-2ee3f222-5975-45a8-b738-7a60aebf8dc5-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD" returned: 0 in 1.017s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-2ee3f222-5975-45a8-b738-7a60aebf8dc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.823s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:16 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-140ca92a-207f-453a-97cc-bd05c4d2ddad" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:16 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:16 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Flow 'volume_create_manager' (1bdbf600-0564-439c-8be7-b6d89b7911fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c3f382-2ff2-4ecc-a28b-971bb2525bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 1.079s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c3f382-2ff2-4ecc-a28b-971bb2525bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1392767678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f295226-4ed9-4687-b33b-1bbaa5c70e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc00ae2c690e43afaa48a838f4459d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:15:16Z,use_quota=True,user_id='deb58b0844f64fa3a0ce8437ce48d457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b89f6bd-9f47-45d7-a442-7a2e4f53dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b89f6bd-9f47-45d7-a442-7a2e4f53dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c2b8f8-b8ec-475e-8558-9734d54645d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c2b8f8-b8ec-475e-8558-9734d54645d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f295226-4ed9-4687-b33b-1bbaa5c70e4f', 'volume_name': 'volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4118869e-dd4f-4066-a51c-60d607c589dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4118869e-dd4f-4066-a51c-60d607c589dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01543ff8-7c2b-4ab9-880e-b139b9afa583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:17 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Volume 3f295226-4ed9-4687-b33b-1bbaa5c70e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f', 'volume_size': 1}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0c90fa33d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1392767678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f295226-4ed9-4687-b33b-1bbaa5c70e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc00ae2c690e43afaa48a838f4459d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:15:16Z,use_quota=True,user_id='deb58b0844f64fa3a0ce8437ce48d457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)}" {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Creating volume 3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:15:17 devstack cinder-volume[83645]: INFO cinder.volume.drivers.remotefs [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] casted to 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f 1073741824 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:17 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=170, name=volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:15:17 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleted volume successfully.
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-140ca92a-207f-453a-97cc-bd05c4d2ddad" acquired by "delete_snapshot" :: waited 0.919s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-2ee3f222-5975-45a8-b738-7a60aebf8dc5" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD" returned: 1 in 1.271s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] dc367a05-b4a3-4c44-8a0b-393abbd9fded was raw, converting to raw {{(pid=83645) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 17 08:15:17 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:18 devstack quobyte-client[83654]: System call of process 101172 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:15:18 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=169, name=volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-301aaa52-e5ed-4012-99de-48ea9bac3685 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-cccb14df-df70-4347-a3ad-c8fb3d9384ec-delete_volume" released by "delete_volume" :: held 5.661s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f 1073741824" returned: 0 in 0.860s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-2ee3f222-5975-45a8-b738-7a60aebf8dc5" acquired by "_delete_snapshot" :: waited 0.407s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleting offline snapshot 2ee3f222-5975-45a8-b738-7a60aebf8dc5 of volume 140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] snapshot_file for this snap is: volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d433df-ebca-4287-a7be-5136ccc4e23e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 0 in 0.650s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc367a05-b4a3-4c44-8a0b-393abbd9fded_mltd55mddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:15:18 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Converted 0.00 MB image at 0.00 MB/s
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 0.447s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] <== create_volume: return (1490ms) {'provider_location': '10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'} {{(pid=83645) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 17 08:15:18 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 1G" returned: 0 in 0.383s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01543ff8-7c2b-4ab9-880e-b139b9afa583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f', 'volume_size': 1}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cd89b4-e557-47e0-b753-4cb933a957c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72e8da8-3263-4530-904d-c2efa6f51f6c]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5" returned: 0 in 0.803s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:19 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Volume volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f (3f295226-4ed9-4687-b33b-1bbaa5c70e4f): created successfully
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cd89b4-e557-47e0-b753-4cb933a957c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Flow 'volume_create_manager' (1bdbf600-0564-439c-8be7-b6d89b7911fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-140ca92a-207f-453a-97cc-bd05c4d2ddad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 08:15:19 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-b67d91a7-ee67-48b9-add8-f3d4fc0ebc42 tempest-SnapshotDependencyTests-1128096989 None] Created volume successfully.
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e1d984-b83b-49e6-b08f-fffd566b7453]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:19 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 0 in 0.963s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad" returned: 0 in 0.966s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:20 devstack quobyte-client[83654]: System call of process 101189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:15:20 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:20 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Creating offline snapshot 00d3f7f5-73ea-44b6-83fa-cb209447694a of volume 3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 1 in 1.008s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Downloaded image dc367a05-b4a3-4c44-8a0b-393abbd9fded ((None, None)) to volume 0fb7b8ed-4934-4eac-8707-c5906a5521a4 successfully. {{(pid=83645) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Temporary image dc367a05-b4a3-4c44-8a0b-393abbd9fded for user c0f5f49d957246acaed996407473fd5c is deleted. {{(pid=83645) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.volume.volume_utils [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Marking volume 0fb7b8ed-4934-4eac-8707-c5906a5521a4 as bootable. {{(pid=83645) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6f8c8e-0c7e-4bc8-aca0-981f2f448db9]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5" returned: 0 in 0.488s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Copying metadata from image dc367a05-b4a3-4c44-8a0b-393abbd9fded to 0fb7b8ed-4934-4eac-8707-c5906a5521a4. {{(pid=83645) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Creating volume glance metadata for volume 0fb7b8ed-4934-4eac-8707-c5906a5521a4 backed by image dc367a05-b4a3-4c44-8a0b-393abbd9fded with: {'image_id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '46481b8c3e19db93c94016c3bc5cd810', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83645) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad.2ee3f222-5975-45a8-b738-7a60aebf8dc5" returned: 0 in 0.346s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-2ee3f222-5975-45a8-b738-7a60aebf8dc5" released by "_delete_snapshot" :: held 3.532s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-140ca92a-207f-453a-97cc-bd05c4d2ddad" released by "delete_snapshot" :: held 3.982s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 0.647s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:21 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a 1G {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:22 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=171, name=volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a 1G" returned: 0 in 0.378s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "qemu-img rebase -u -b volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f -F qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.375s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cb3a55c-b65a-4d93-aa85-31292f81b558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4', 'volume_size': 1, 'image_id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46481b8c3e19db93c94016c3bc5cd810', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '05b0edccba2b4468a68c178cd7ef9f05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b465e689ae48ceba5b044490c3acd30017022440f06eee12704c3db6d7793c7305de2a83e363a30273e338bf8548a36ef9a9b74f114bb627199a8ef376ea622', 'id': 'dc367a05-b4a3-4c44-8a0b-393abbd9fded', 'created_at': datetime.datetime(2025, 9, 17, 6, 14, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc367a05-b4a3-4c44-8a0b-393abbd9fded/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0c8607e5c0>}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6574fa1d-042f-433b-931f-8220e64c8e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['085209a3-e943-4eda-aa43-4ad45a3a52b9', 'd09778cd-276e-4064-99c8-121781141f46', '53d8b87e-a380-4444-9089-56107e913350', 'b6877cfe-713e-4310-98ea-226631ff93af'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.350s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Setting permissions: /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f -> 1000:1000 {{(pid=83645) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 17 08:15:22 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:23 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Volume volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 (0fb7b8ed-4934-4eac-8707-c5906a5521a4): created successfully
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6574fa1d-042f-433b-931f-8220e64c8e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Flow 'volume_create_manager' (e873db9b-82a7-4842-ab24-2f3505faeed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Acquiring lock "cinder-0fb7b8ed-4934-4eac-8707-c5906a5521a4-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:23 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-52d585ac-9f01-4c0c-9b7b-1da794d415fb tempest-VolumeImageDependencyTests-1585449718 None] Created volume successfully.
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.532s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Lock "cinder-0fb7b8ed-4934-4eac-8707-c5906a5521a4-delete_volume" acquired by "delete_volume" :: waited 0.331s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.info" returned: 0 in 0.373s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.info is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:15:23 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.info {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:24 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Acquiring lock "cinder-quobyte-0fb7b8ed-4934-4eac-8707-c5906a5521a4" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.info" returned: 0 in 0.426s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.493s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Lock "cinder-quobyte-0fb7b8ed-4934-4eac-8707-c5906a5521a4" acquired by "delete_volume" :: waited 0.140s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-140ca92a-207f-453a-97cc-bd05c4d2ddad-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed3d20d-0ecb-4f08-ac12-0395625c0e56]: (4, 'raw') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:24 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Delete snapshot completed successfully.
Sep 17 08:15:24 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-43d8b6be-df68-4537-96ac-26ea39306ed9 tempest-SnapshotDependencyTests-1128096989 None] Create snapshot completed successfully
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-cff29d70-43ea-4099-8c10-6a8cfd1fe51a tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-2ee3f222-5975-45a8-b738-7a60aebf8dc5-delete_snapshot" released by "delete_snapshot" :: held 8.183s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:24 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-140ca92a-207f-453a-97cc-bd05c4d2ddad-delete_volume" acquired by "delete_volume" :: waited 0.412s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:25 devstack quobyte-client[83654]: System call of process 101208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:15:25 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "cinder-quobyte-140ca92a-207f-453a-97cc-bd05c4d2ddad" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 0 in 0.566s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-140ca92a-207f-453a-97cc-bd05c4d2ddad" acquired by "delete_volume" :: waited 0.205s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187d96a-bf5f-47b8-acd1-1ab5b3b34b71]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 1 in 0.627s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4' failed. Not Retrying. {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:25 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-0fb7b8ed-4934-4eac-8707-c5906a5521a4" returned: 0 in 0.138s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad" returned: 0 in 0.632s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Lock "cinder-quobyte-0fb7b8ed-4934-4eac-8707-c5906a5521a4" released by "delete_volume" :: held 1.775s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-140ca92a-207f-453a-97cc-bd05c4d2ddad" returned: 0 in 0.483s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-quobyte-140ca92a-207f-453a-97cc-bd05c4d2ddad" released by "delete_volume" :: held 1.322s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:26 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83645) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Flow 'volume_create_manager' (7811628d-3a2d-41fe-a144-5d5a8ea4dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac960349-5ae0-43f1-857a-45c6431e2bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Created reservations ['4929b62c-bfb5-443e-8b9b-9a24321606dd', '68693430-0351-46dd-a72f-2b34e8a28a6b', '3e1647e0-f48a-4d72-9b01-3e8b9a420316', 'd4bbe880-e042-43c6-a1cb-eb97bc8f9522'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac960349-5ae0-43f1-857a-45c6431e2bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-17T06:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add70613-4feb-406d-b916-30111ff008f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc00ae2c690e43afaa48a838f4459d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00d3f7f5-73ea-44b6-83fa-cb209447694a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:15:27Z,use_quota=True,user_id='deb58b0844f64fa3a0ce8437ce48d457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c66e730-3e1c-4ac2-946c-2a9bad36cd37),volume_type_id=7c66e730-3e1c-4ac2-946c-2a9bad36cd37)' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bbe116-3cb2-4f1e-b15f-513430130f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84bbe116-3cb2-4f1e-b15f-513430130f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22453aa5-7032-4efe-93b2-d6b4e5206b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22453aa5-7032-4efe-93b2-d6b4e5206b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'add70613-4feb-406d-b916-30111ff008f9', 'volume_name': 'volume-add70613-4feb-406d-b916-30111ff008f9', 'volume_size': 1, 'snapshot_id': '00d3f7f5-73ea-44b6-83fa-cb209447694a'}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08a853e-c2e9-4ab9-baab-a4fdcc198c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08a853e-c2e9-4ab9-baab-a4fdcc198c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:26 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a2947f-59c1-4d16-b3ed-825f2d31c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:26 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Volume add70613-4feb-406d-b916-30111ff008f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-add70613-4feb-406d-b916-30111ff008f9', 'volume_size': 1, 'snapshot_id': '00d3f7f5-73ea-44b6-83fa-cb209447694a'}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Created reservations ['734fcc41-439b-4b78-82be-b6756c9af4ca', 'bfaed0c2-caaf-4269-9641-9e90b8c835f5', '36b37e57-0afc-4a43-b13a-c429028fcbd2', '36d6bd28-97a2-4337-917d-8942b5154bd5'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-quobyte-00d3f7f5-73ea-44b6-83fa-cb209447694a-add70613-4feb-406d-b916-30111ff008f9" by "_create_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-00d3f7f5-73ea-44b6-83fa-cb209447694a-add70613-4feb-406d-b916-30111ff008f9" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Creating volume add70613-4feb-406d-b916-30111ff008f9 from snapshot 00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Selected 10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26 as target Quobyte volume. {{(pid=83645) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-quobyte-add70613-4feb-406d-b916-30111ff008f9" by "_copy_volume_from_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-add70613-4feb-406d-b916-30111ff008f9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] snapshot: 00d3f7f5-73ea-44b6-83fa-cb209447694a, volume: add70613-4feb-406d-b916-30111ff008f9,  {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb3d9ec-52dc-44a6-b9c7-08495ca086fe]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.629s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.307s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Creating direct copy from snapshot {{(pid=83645) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6b92c-b07e-4371-ade5-fcb737ac684e]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:27 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.070s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:28 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:28 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:29 devstack quobyte-client[83654]: System call of process 101237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:15:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Deleted volume successfully.
Sep 17 08:15:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.686s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 1.451s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:29 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:29 devstack cinder-volume[83645]: DEBUG cinder.utils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 not found in is_blk_device check {{(pid=83645) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 17 08:15:29 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:29 devstack quobyte-client[83654]: System call of process 101265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 17 08:15:29 devstack quobyte-client[83654]: The server volume:6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6e3d7336-0b08-4a68-a7f7-6d2d054f8e9e, inode=173, name=volume-add70613-4feb-406d-b916-30111ff008f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.6), requestorAccessMask=0
Sep 17 08:15:29 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Deleted volume successfully.
Sep 17 08:15:30 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-0ebae2b0-065c-43c8-8f2b-8b23e0d3bb85 tempest-CreateVolumesFromSnapshotTest-436699438 None] Lock "cinder-140ca92a-207f-453a-97cc-bd05c4d2ddad-delete_volume" released by "delete_volume" :: held 5.749s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:31 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-d353ca3c-2ffb-436c-a6b2-0ad87e18ae04 tempest-VolumeImageDependencyTests-1585449718 None] Lock "cinder-0fb7b8ed-4934-4eac-8707-c5906a5521a4-delete_volume" released by "delete_volume" :: held 7.515s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9" returned: 0 in 6.157s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:35 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d70fa-c480-4966-a1c9-a3edfc48a496]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:35 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 0.559s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.image.image_utils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Image conversion details: src /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 {{(pid=83645) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 17 08:15:36 devstack cinder-volume[83645]: INFO cinder.image.image_utils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Converted 1024.00 MB image at 166.21 MB/s
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] File path /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 is being set with permissions: 660 {{(pid=83645) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9" returned: 0 in 0.104s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-add70613-4feb-406d-b916-30111ff008f9" released by "_copy_volume_from_snapshot" :: held 9.333s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-00d3f7f5-73ea-44b6-83fa-cb209447694a-add70613-4feb-406d-b916-30111ff008f9" released by "_create_volume_from_snapshot" :: held 9.377s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.411s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a2947f-59c1-4d16-b3ed-825f2d31c075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add70613-4feb-406d-b916-30111ff008f9', 'volume_size': 1, 'snapshot_id': '00d3f7f5-73ea-44b6-83fa-cb209447694a'}' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bebfca-fd87-46fb-9b24-7549e8be94a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 17 08:15:36 devstack cinder-volume[83645]: INFO cinder.volume.flows.manager.create_volume [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Volume volume-add70613-4feb-406d-b916-30111ff008f9 (add70613-4feb-406d-b916-30111ff008f9): created successfully
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bebfca-fd87-46fb-9b24-7549e8be94a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83645) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 17 08:15:36 devstack cinder-volume[83645]: DEBUG cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Flow 'volume_create_manager' (7811628d-3a2d-41fe-a144-5d5a8ea4dd52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83645) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 17 08:15:36 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-6d7b91ec-1827-45ac-8ea3-e322add9d349 tempest-SnapshotDependencyTests-1128096989 None] Created volume successfully.
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-00d3f7f5-73ea-44b6-83fa-cb209447694a-delete_snapshot" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-00d3f7f5-73ea-44b6-83fa-cb209447694a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:37 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-quobyte-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" by "delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-quobyte-00d3f7f5-73ea-44b6-83fa-cb209447694a" by "_delete_snapshot" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-00d3f7f5-73ea-44b6-83fa-cb209447694a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Deleting offline snapshot 00d3f7f5-73ea-44b6-83fa-cb209447694a of volume 3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] snapshot_file for this snap is: volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b65b63e-8574-46eb-83dc-6bf850260a10]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:37 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.367s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.remotefs [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83645) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba06ced-15ae-4223-bb6b-c29cf54fa06f]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 0.395s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.177s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f.00d3f7f5-73ea-44b6-83fa-cb209447694a" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-00d3f7f5-73ea-44b6-83fa-cb209447694a" released by "_delete_snapshot" :: held 1.321s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:38 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" released by "delete_snapshot" :: held 1.349s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Created reservations ['3159b19d-33cb-4bed-a49b-f2379d8dab27', '48357cc5-be97-4b86-a262-8f8107bd235c', 'dfc05aa4-1aff-4b16-8e10-80315e19eb49', '2d03f28d-2f69-487e-af34-54fb2ee43028'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:39 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Delete snapshot completed successfully.
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-e0d804c4-95e4-42ae-ad6d-88d065dbef14 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-00d3f7f5-73ea-44b6-83fa-cb209447694a-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-3f295226-4ed9-4687-b33b-1bbaa5c70e4f-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-3f295226-4ed9-4687-b33b-1bbaa5c70e4f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:39 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-quobyte-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" acquired by "delete_volume" :: waited 0.014s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc97a6c-2c76-4280-a67b-a8f665875c96]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:39 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 0.419s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" returned: 0 in 0.102s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-3f295226-4ed9-4687-b33b-1bbaa5c70e4f" released by "delete_volume" :: held 0.680s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Created reservations ['86f46ac3-d79a-443b-8411-c79a7aa893f2', '4459ae95-0409-48ea-bf4c-d3525499aa9e', '53ab29f0-6373-48bf-9cf8-3bf9f2e725c0', '9300323c-dc5b-4697-82ec-5a217f2b36ce'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:40 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:41 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:41 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:41 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Deleted volume successfully.
Sep 17 08:15:41 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-da75a126-a1ee-4d0f-9f84-1ac37459e032 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-3f295226-4ed9-4687-b33b-1bbaa5c70e4f-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-add70613-4feb-406d-b916-30111ff008f9-delete_volume" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-add70613-4feb-406d-b916-30111ff008f9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:42 devstack cinder-volume[83645]: WARNING cinder.volume.volume_utils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "cinder-quobyte-add70613-4feb-406d-b916-30111ff008f9" by "delete_volume" {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-add70613-4feb-406d-b916-30111ff008f9" acquired by "delete_volume" :: waited 0.012s {{(pid=83645) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e495e-d9e1-4513-9311-612d59342550]: (4, 'qcow2') {{(pid=84910) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9" returned: 0 in 0.365s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] CMD "rm -f /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9/volume-add70613-4feb-406d-b916-30111ff008f9" returned: 0 in 0.092s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:42 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-quobyte-add70613-4feb-406d-b916-30111ff008f9" released by "delete_volume" :: held 0.620s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG cinder.quota [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Created reservations ['e5cc1937-b27c-4298-a3bb-93988970cf81', '65092fcd-8d1b-48f2-9889-59acf03702c4', '408d3f35-de5e-473d-8679-45b4dbf20d42', 'a640e554-c3e1-40f6-bf84-e651daf8ffba'] {{(pid=83645) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.081s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:43 devstack cinder-volume[83645]: INFO cinder.volume.manager [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Deleted volume successfully.
Sep 17 08:15:43 devstack cinder-volume[83645]: DEBUG cinder.coordination [None req-852a7d0a-0f43-4504-ba28-880f30403348 tempest-SnapshotDependencyTests-1128096989 None] Lock "cinder-add70613-4feb-406d-b916-30111ff008f9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=83645) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG oslo_service.periodic_task [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83645) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26': None} {{(pid=83645) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Available shares ['10.10.41.181/cinder-vol-18b72c1d-2dbc-48a8-9403-0902a615eb26'] {{(pid=83645) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.lockutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83645) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9 {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG oslo_concurrency.processutils [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2eeaa3f431e974271a7771d6d20a42f9" returned: 0 in 0.111s {{(pid=83645) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 17 08:15:46 devstack cinder-volume[83645]: DEBUG cinder.manager [None req-9c5b1eee-027d-4bde-9dc5-f786a2943701 None None] Notifying Schedulers of capabilities ... {{(pid=83645) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 17 08:15:53 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:UPDATE=101,cinder:DELETE=8,cinder:SELECT=57,cinder:INSERT=29 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 17 08:15:55 devstack cinder-volume[83645]: DEBUG dbcounter [-] [83645] Writing DB stats cinder:DELETE=9,cinder:UPDATE=90,cinder:SELECT=73,cinder:INSERT=24 {{(pid=83645) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}